Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 14 03:11:12 devstack cinder-volume[72701]: INFO dbcounter [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Registered counter for database cinder
Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG oslo_db.sqlalchemy.engines [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG dbcounter [-] [72701] Writer thread running {{(pid=72701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 14 03:11:12 devstack cinder-volume[72701]: INFO cinder.rpc [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 14 03:11:12 devstack cinder-volume[72701]: INFO cinder.rpc [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG oslo_db.sqlalchemy.engines [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:11:12 devstack cinder-volume[72701]: INFO cinder.volume.manager [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Determined volume DB was empty at startup.
Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG cinder.volume.manager [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72701) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Nov 14 03:11:12 devstack cinder-volume[72701]: INFO cinder.volume.manager [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 14 03:11:12 devstack cinder-volume[72701]: WARNING stevedore.named [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 14 03:11:12 devstack cinder-volume[72701]: WARNING castellan.key_manager [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 14 03:11:12 devstack cinder-volume[72701]: WARNING cinder.keymgr.conf_key_mgr [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG cinder.volume.drivers.lvm [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72701) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Nov 14 03:11:12 devstack cinder-volume[72701]: DEBUG oslo_concurrency.processutils [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_concurrency.processutils [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] CMD "cinder-rtstool verify" returned: 0 in 0.276s {{(pid=72701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_db.sqlalchemy.engines [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:11:13 devstack cinder-volume[72701]: INFO cinder.rpc [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 14 03:11:13 devstack cinder-volume[72701]: INFO cinder.rpc [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 14 03:11:13 devstack cinder-volume[72701]: WARNING stevedore.named [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 14 03:11:13 devstack cinder-volume[72701]: WARNING castellan.key_manager [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 14 03:11:13 devstack cinder-volume[72701]: INFO cinder.volume.manager [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_db.sqlalchemy.engines [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:11:13 devstack cinder-volume[72701]: INFO oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Starting 1 workers
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Started child 72800 {{(pid=72701) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Full set of CONF: {{(pid=72701) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] ******************************************************************************** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Configuration options gathered from: {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] ================================================================================ {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] allow_availability_zone_fallback = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] allow_compression_on_image_upload = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] allowed_direct_url_schemes     = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] api_rate_limit                 = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] auth_strategy                  = keystone {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72800]: INFO cinder.service [-] Starting cinder-volume node (version 26.2.1)
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] az_cache_duration              = 3600 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_availability_zone      = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_host                   = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_name                   = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_stats_polling_interval = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backup_api_class               = cinder.backup.api.API {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backup_name_template           = backup-%s {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backup_use_same_host           = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backup_use_temp_snapshot       = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] chap_password                  = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] chap_username                  =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_internal_tenant_project_id = 7953473a1a604ea7ad7c553cae8a75b2 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_internal_tenant_user_id = ae43879f9c3e49c0b66d7f5f427da401 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cloned_volume_same_az          = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cluster                        = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] compression_format             = gzip {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] compute_api_class              = cinder.compute.nova.API {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] config_dir                     = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] config_source                  = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] control_exchange               = openstack {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] debug                          = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] default_availability_zone      = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] default_group_type             = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] default_volume_type            = lvmdriver-1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] driver_client_cert             = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] driver_client_cert_key         = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] driver_data_namespace          = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] driver_ssl_cert_path           = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] driver_ssl_cert_verify         = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] driver_use_ssl                 = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] enable_force_upload            = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] enable_new_services            = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] enable_unsupported_driver      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] enforce_multipath_for_image_xfer = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] filter_function                = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_api_insecure            = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_api_servers             = ['http://192.168.122.143/image'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_api_ssl_compression     = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_ca_certificates_file    = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_catalog_info            = image:glance:publicURL {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_certfile                = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_keyfile                 = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_num_retries             = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] glance_request_timeout         = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] goodness_function              = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] graceful_shutdown_timeout      = 5 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] group_api_class                = cinder.group.api.API {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] host                           = devstack {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_compress_on_upload       = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_conversion_address_space_limit = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_conversion_cpu_limit     = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_conversion_disable       = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_upload_use_cinder_backend = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_upload_use_internal_tenant = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_volume_cache_enabled     = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_volume_cache_max_count   = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] image_volume_cache_max_size_gb = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] init_host_max_objects_retrieval = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] instance_format                = [instance: %(uuid)s]  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] iscsi_iotype                   = fileio {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] iscsi_target_flags             =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] iscsi_write_cache              = on {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] iser_helper                    = tgtadm {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] iser_ip_address                = 192.168.122.143 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] iser_port                      = 3260 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_color                      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_config_append              = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_dir                        = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_file                       = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_options                    = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_rotate_interval            = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_rotate_interval_type       = days {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] log_rotation_type              = none {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] max_age                        = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] max_logfile_count              = 30 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] max_logfile_size_mb            = 200 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] max_over_subscription_ratio    = 20.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] message_reap_interval          = 86400 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] message_ttl                    = 2592000 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] migration_create_volume_timeout_secs = 300 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] monkey_patch                   = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] monkey_patch_modules           = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] my_ip                          = 192.168.122.143 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] no_snapshot_gb_quota           = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] num_iser_scan_tries            = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] num_shell_tries                = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] num_volume_device_scan_tries   = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] nvmeof_conn_info_version       = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] nvmet_ns_id                    = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] nvmet_port_id                  = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] osapi_max_limit                = 1000 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] osapi_volume_ext_list          = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] osapi_volume_listen_port       = 8776 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] osapi_volume_use_ssl           = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] osapi_volume_workers           = 2 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] per_volume_size_limit          = -1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] periodic_fuzzy_delay           = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] periodic_interval              = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] public_endpoint                = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] publish_errors                 = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] quota_backup_gigabytes         = 1000 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] quota_backups                  = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] quota_gigabytes                = 1000 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] quota_groups                   = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] quota_snapshots                = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] quota_volumes                  = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] rate_limit_burst               = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] rate_limit_except_level        = CRITICAL {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] rate_limit_interval            = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] reinit_driver_count            = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] replication_device             = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] report_discard_supported       = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] report_interval                = 120 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] reservation_clean_interval     = 86400 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] reservation_expire             = 86400 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] reserved_image_namespaces      = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] reserved_percentage            = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] rpc_response_timeout           = 120 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] run_external_periodic_tasks    = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] scst_target_driver             = iscsi {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] scst_target_iqn_name           = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_down_time              = 720 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] shell_completion               = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] snapshot_name_template         = snapshot-%s {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] snapshot_same_host             = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] split_loggers                  = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] state_path                     = /opt/stack/data/cinder {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] storage_availability_zone      = nova {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] storage_protocol               = iSCSI {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] syslog_log_facility            = LOG_USER {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] target_helper                  = lioadm {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] target_ip_address              = 192.168.122.143 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] target_port                    = 3260 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] target_protocol                = iscsi {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] target_secondary_ip_addresses  = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] trace_flags                    = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] transport_url                  = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] until_refresh                  = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] use_chap_auth                  = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] use_default_quota_class        = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] use_journal                    = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] use_json                       = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] use_multipath_for_image_xfer   = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] use_stderr                     = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] use_syslog                     = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] verify_glance_signatures       = enabled {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_api_class               = cinder.volume.api.API {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_backend_name            = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_clear                   = zero {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_clear_ionice            = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_clear_size              = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_copy_bps_limit          = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_dd_blocksize            = 1M {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_name_template           = volume-%s {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_service_inithost_offload = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volume_usage_audit_period      = month {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] watch_log_file                 = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] zoning_mode                    = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72800]: INFO cinder.volume.manager [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_concurrency.disable_process_locking = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.admin_password = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.admin_token = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.admin_user  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.auth_port   = 35357 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.auth_protocol = https {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.auth_section = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.auth_type   = password {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.auth_uri    = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.auth_version = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.cache       = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.certfile    = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.delay_auth_decision = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.http_connect_timeout = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.identity_uri = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.include_service_catalog = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.insecure    = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.interface   = public {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.keyfile     = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_password =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcache_username =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.region_name = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.service_token_roles_required = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.service_type = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.token_cache_time = 300 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] keystone_authtoken.www_authenticate_uri = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.backend                  = dogpile.cache.null {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.backend_argument         = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.backend_expiration_time  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.config_prefix            = cache.oslo {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.dead_timeout             = 60.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.debug_cache_backend      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.enable_retry_client      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.enable_socket_keepalive  = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.enabled                  = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.enforce_fips_mode        = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.expiration_time          = 600 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.hashclient_retry_attempts = 2 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_dead_retry      = 300 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_password        = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_pool_maxsize    = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_sasl_enabled    = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.memcache_username        = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.proxies                  = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.redis_db                 = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.redis_password           = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.redis_sentinel_service_name = mymaster {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.redis_server             = localhost:6379 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.redis_socket_timeout     = 1.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.redis_username           = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.retry_attempts           = 2 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.retry_delay              = 0.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.socket_keepalive_count   = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.socket_keepalive_idle    = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.socket_keepalive_interval = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.tls_allowed_ciphers      = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.tls_cafile               = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.tls_certfile             = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.tls_enabled              = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cache.tls_keyfile              = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] coordination.backend_url       = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.asyncio_connection    = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.asyncio_slave_connection = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.backend               = sqlalchemy {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.connection            = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.connection_debug      = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.connection_parameters =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.connection_recycle_time = 3600 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.connection_trace      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.db_inc_retry_interval = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.db_max_retries        = 20 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.db_max_retry_interval = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.db_retry_interval     = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.max_overflow          = 50 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.max_pool_size         = 5 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.max_retries           = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.mysql_wsrep_sync_wait = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.pool_timeout          = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.retry_interval        = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.slave_connection      = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.sqlite_synchronous    = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] database.use_db_reconnect      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.connection_string     = messaging:// {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.enabled               = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.es_doc_type           = notification {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.es_scroll_size        = 10000 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.es_scroll_time        = 2m {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.filter_error_trace    = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.hmac_keys             = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.sentinel_service_name = mymaster {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.socket_timeout        = 0.1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.trace_requests        = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler.trace_sqlalchemy      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler_jaeger.process_tags   = {} {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler_jaeger.service_name_prefix = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] profiler_otlp.service_name_prefix = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.enforce_new_defaults = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: WARNING oslo_config.cfg [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.enforce_scope      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.policy_default_rule = default {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.policy_file        = policy.yaml {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] privsep_osbrick.group          = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] privsep_osbrick.helper_command = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] privsep_osbrick.user           = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_sys_admin.group         = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_sys_admin.helper_command = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] cinder_sys_admin.user          = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.auth_section      = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.auth_type         = password {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.certfile          = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.collect_timing    = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.insecure          = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.keyfile           = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.send_service_user_token = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.split_loggers     = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] service_user.timeout           = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.backend_availability_zone = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.chap_password = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.chap_username =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.driver_client_cert = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.driver_client_cert_key = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.driver_data_namespace = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.driver_use_ssl = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.enable_unsupported_driver = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.extra_capabilities = {} {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.filter_function = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.goodness_function = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.iscsi_iotype  = fileio {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.iscsi_target_flags =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.iscsi_write_cache = on {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.iser_helper   = tgtadm {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.iser_ip_address = 192.168.122.143 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.iser_port     = 3260 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.lvm_share_target = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.lvm_type      = auto {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.num_shell_tries = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.nvmet_port_id = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.replication_device = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.report_discard_supported = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.reserved_percentage = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.scst_target_driver = iscsi {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.scst_target_iqn_name = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.storage_protocol = iSCSI {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.target_helper = tgtadm {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.target_ip_address = 192.168.122.143 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.target_port   = 3260 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.target_protocol = iscsi {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.trace_flags   = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.unique_fqdn_network = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.use_chap_auth = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_backend_name = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_clear  = zero {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_clear_ionice = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_clear_size = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_reports.file_event_handler = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_reports.log_dir           = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.backend_availability_zone = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.backend_host       = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.chap_password      = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.chap_username      = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.driver_client_cert = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.driver_data_namespace = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.extra_capabilities = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.filter_function    = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.goodness_function  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.iscsi_iotype       = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.iser_helper        = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.iser_ip_address    = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.iser_port          = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.iser_target_prefix = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.lvm_share_target   = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.lvm_type           = auto {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.num_shell_tries    = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.replication_device = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.report_discard_supported = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.reserved_percentage = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.scst_target_driver = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.storage_protocol   = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.target_helper      = lioadm {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.target_ip_address  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.target_port        = 3260 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.trace_flags        = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.use_chap_auth      = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_clear       = zero {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_clear_size  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] lvmdriver-1.volumes_dir        = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.ssl      = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_notifications.driver = [] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_notifications.retry = -1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] oslo_messaging_notifications.transport_url = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] key_manager.fixed_key          = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.barbican_api_version  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.barbican_endpoint     = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.barbican_endpoint_type = public {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.barbican_region_name  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.cafile                = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.certfile              = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.collect_timing        = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.insecure              = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.keyfile               = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.number_of_retries     = 60 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.retry_delay           = 1 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.send_service_user_token = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.split_loggers         = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.timeout               = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.verify_ssl            = True {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican.verify_ssl_path       = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.auth_section = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.auth_type = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.cafile   = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.certfile = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.collect_timing = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.insecure = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.keyfile  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.split_loggers = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] barbican_service_user.timeout  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.approle_role_id          = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.approle_secret_id        = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.kv_mountpoint            = secret {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.kv_path                  = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.kv_version               = 2 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.namespace                = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack sudo[72810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.root_token_id            = **** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.ssl_ca_crt_file          = None {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.timeout                  = 60.0 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.use_ssl                  = False {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:11:13 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] ******************************************************************************** {{(pid=72701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Nov 14 03:11:13 devstack sudo[72810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:14 devstack sudo[72810]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:14 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:14 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:14 devstack sudo[72909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:14 devstack sudo[72909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:14 devstack sudo[72909]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:14 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.514s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:14 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:11:14 devstack cinder-volume[72800]: INFO cinder.brick.local_dev.lvm [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 14 03:11:14 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:14 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:14 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:14 devstack sudo[73179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 14 03:11:14 devstack sudo[73179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:15 devstack sudo[73179]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:15 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.561s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:15 devstack cinder-volume[72800]: DEBUG cinder.brick.local_dev.lvm [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72800) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Nov 14 03:11:15 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:15 devstack sudo[73355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:15 devstack sudo[73355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:15 devstack sudo[73355]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:15 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.848s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:15 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:15 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:15 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:16 devstack sudo[73462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:16 devstack sudo[73462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:16 devstack sudo[73462]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:16 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:16 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:16 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:16 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:16 devstack sudo[73523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 14 03:11:16 devstack sudo[73523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:16 devstack sudo[73523]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:16 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.462s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:16 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:16 devstack sudo[73526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 14 03:11:16 devstack sudo[73526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:17 devstack sudo[73526]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:17 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:17 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:17 devstack sudo[73534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 14 03:11:17 devstack sudo[73534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:17 devstack sudo[73534]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:17 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:17 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:17 devstack sudo[73537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:11:17 devstack sudo[73537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:18 devstack sudo[73537]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:18 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:18 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:18 devstack sudo[73542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:18 devstack sudo[73542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:18 devstack sudo[73542]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:18 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:18 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:18 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:18 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:18 devstack sudo[73546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:18 devstack sudo[73546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:19 devstack sudo[73546]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:19 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.472s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:19 devstack cinder-volume[72800]: INFO cinder.volume.drivers.lvm [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 14 03:11:19 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:19 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:19 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:19 devstack sudo[73559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:19 devstack sudo[73559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:19 devstack sudo[73559]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:19 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:19 devstack cinder-volume[72800]: DEBUG cinder.volume.drivers.lvm [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Updating volume stats {{(pid=72800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Nov 14 03:11:19 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:19 devstack sudo[73671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 14 03:11:19 devstack sudo[73671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:20 devstack sudo[73671]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:20 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:20 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:20 devstack sudo[73721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:11:20 devstack sudo[73721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:20 devstack sudo[73721]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:20 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:20 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:20 devstack sudo[73813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:20 devstack sudo[73813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:21 devstack sudo[73813]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:21 devstack sudo[73819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:11:21 devstack sudo[73819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:21 devstack sudo[73819]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:21 devstack cinder-volume[72800]: INFO cinder.volume.driver [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Driver hasn't implemented _init_vendor_properties()
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG cinder.volume.driver [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72800) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}}
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG oslo_db.sqlalchemy.engines [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72800) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG dbcounter [-] [72800] Writer thread running {{(pid=72800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG cinder.db.sqlalchemy.api [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Building query based on filter {{(pid=72800) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG cinder.image.image_utils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72800) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Nov 14 03:11:21 devstack cinder-volume[72800]: INFO cinder.keymgr.migration [None req-2c7969e3-df2f-4d34-89e3-6d64115349a5 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG cinder.volume.drivers.lvm [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Updating volume stats {{(pid=72800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Nov 14 03:11:21 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:21 devstack sudo[73825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 14 03:11:21 devstack sudo[73825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:22 devstack sudo[73825]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:22 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:22 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:22 devstack sudo[73828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:11:22 devstack sudo[73828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:22 devstack sudo[73828]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:22 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:22 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:23 devstack sudo[73835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:23 devstack sudo[73835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:23 devstack cinder-volume[72701]: DEBUG dbcounter [-] [72701] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:11:23 devstack sudo[73835]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:23 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.535s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:23 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:23 devstack sudo[73841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:11:23 devstack sudo[73841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:24 devstack sudo[73841]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:24 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:24 devstack cinder-volume[72800]: DEBUG cinder.manager [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Notifying Schedulers of capabilities ... {{(pid=72800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:11:24 devstack cinder-volume[72800]: INFO cinder.volume.manager [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Driver initialization completed successfully.
Nov 14 03:11:24 devstack cinder-volume[72800]: INFO cinder.manager [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Initiating service 2 cleanup
Nov 14 03:11:24 devstack cinder-volume[72800]: INFO cinder.manager [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Service 2 cleanup completed.
Nov 14 03:11:24 devstack cinder-volume[72800]: DEBUG cinder.service [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Creating RPC server for service cinder-volume {{(pid=72800) start /opt/stack/cinder/cinder/service.py:239}}
Nov 14 03:11:24 devstack cinder-volume[72800]: DEBUG cinder.service [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72800) start /opt/stack/cinder/cinder/service.py:245}}
Nov 14 03:11:24 devstack cinder-volume[72800]: INFO cinder.volume.manager [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 14 03:11:24 devstack cinder-volume[72800]: DEBUG cinder.volume.drivers.lvm [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Updating volume stats {{(pid=72800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Nov 14 03:11:24 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:24 devstack sudo[73846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 14 03:11:24 devstack sudo[73846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:24 devstack sudo[73846]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:24 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:24 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:24 devstack sudo[73903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:11:24 devstack sudo[73903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:25 devstack sudo[73903]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:25 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:25 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:25 devstack sudo[73957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:11:25 devstack sudo[73957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:25 devstack sudo[73957]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:25 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:25 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:11:25 devstack sudo[74034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:11:25 devstack sudo[74034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:11:25 devstack sudo[74034]: pam_unix(sudo:session): session closed for user root
Nov 14 03:11:25 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:11:25 devstack cinder-volume[72800]: INFO cinder.volume.manager [None req-1b083961-fc55-47a9-acb6-8b360753c1f9 None None] Driver post RPC initialization completed successfully.
Nov 14 03:11:35 devstack cinder-volume[72800]: DEBUG dbcounter [-] [72800] Writing DB stats cinder:SELECT=4 {{(pid=72800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:11:35 devstack cinder-volume[72800]: DEBUG dbcounter [-] [72800] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:12:39 devstack cinder-volume[72800]: DEBUG oslo_service.periodic_task [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:12:39 devstack cinder-volume[72800]: DEBUG cinder.volume.drivers.lvm [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] Updating volume stats {{(pid=72800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Nov 14 03:12:39 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:12:39 devstack sudo[78807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 14 03:12:39 devstack sudo[78807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:12:40 devstack sudo[78807]: pam_unix(sudo:session): session closed for user root
Nov 14 03:12:40 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:12:40 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:12:40 devstack sudo[78811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:12:40 devstack sudo[78811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:12:40 devstack sudo[78811]: pam_unix(sudo:session): session closed for user root
Nov 14 03:12:40 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:12:40 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:12:40 devstack sudo[78814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 14 03:12:40 devstack sudo[78814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:12:41 devstack sudo[78814]: pam_unix(sudo:session): session closed for user root
Nov 14 03:12:41 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:12:41 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:12:41 devstack sudo[78817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 14 03:12:41 devstack sudo[78817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:12:41 devstack sudo[78817]: pam_unix(sudo:session): session closed for user root
Nov 14 03:12:41 devstack cinder-volume[72800]: DEBUG oslo_concurrency.processutils [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:12:41 devstack cinder-volume[72800]: DEBUG cinder.manager [None req-ed0377aa-dcf6-43d9-9d68-73a510129ded None None] Notifying Schedulers of capabilities ... {{(pid=72800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:13:35 devstack cinder-volume[72800]: DEBUG dbcounter [-] [72800] Writing DB stats cinder:SELECT=1 {{(pid=72800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:13:35 devstack cinder-volume[72800]: DEBUG dbcounter [-] [72800] Writing DB stats cinder:UPDATE=1 {{(pid=72800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:13:38 devstack cinder-volume[72701]: INFO oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Caught SIGTERM, stopping children
Nov 14 03:13:38 devstack cinder-volume[72701]: DEBUG oslo_concurrency.lockutils [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Acquiring lock "singleton_lock" {{(pid=72701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 14 03:13:38 devstack cinder-volume[72701]: DEBUG oslo_concurrency.lockutils [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Acquired lock "singleton_lock" {{(pid=72701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 14 03:13:38 devstack cinder-volume[72701]: DEBUG oslo_concurrency.lockutils [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Releasing lock "singleton_lock" {{(pid=72701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 14 03:13:38 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Stop services. {{(pid=72701) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Nov 14 03:13:38 devstack cinder-volume[72701]: DEBUG oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Killing children. {{(pid=72701) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Nov 14 03:13:38 devstack cinder-volume[72701]: INFO oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Waiting on 1 children to exit
Nov 14 03:13:39 devstack cinder-volume[72800]: DEBUG oslo_concurrency.lockutils [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Acquiring lock "singleton_lock" {{(pid=72800) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 14 03:13:39 devstack cinder-volume[72800]: DEBUG oslo_concurrency.lockutils [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Acquired lock "singleton_lock" {{(pid=72800) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 14 03:13:39 devstack cinder-volume[72800]: DEBUG oslo_concurrency.lockutils [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Releasing lock "singleton_lock" {{(pid=72800) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 14 03:13:39 devstack cinder-volume[72800]: WARNING amqp [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 14 03:13:39 devstack cinder-volume[72800]: WARNING amqp [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 14 03:13:39 devstack cinder-volume[72701]: INFO oslo_service.backend._eventlet.service [None req-d9964e73-fa04-466c-baa0-5824906cab2e None None] Child 72800 exited with status 0
Nov 14 03:13:40 devstack cinder-volume[80174]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 14 03:13:40 devstack cinder-volume[80174]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 14 03:13:40 devstack cinder-volume[80174]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 14 03:13:41 devstack cinder-volume[80174]: INFO dbcounter [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Registered counter for database cinder
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_db.sqlalchemy.engines [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG dbcounter [-] [80174] Writer thread running {{(pid=80174) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 14 03:13:41 devstack cinder-volume[80174]: INFO cinder.rpc [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 14 03:13:41 devstack cinder-volume[80174]: INFO cinder.rpc [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_db.sqlalchemy.engines [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:13:41 devstack cinder-volume[80174]: INFO cinder.volume.manager [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Determined volume DB was empty at startup.
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG cinder.volume.manager [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80174) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Nov 14 03:13:41 devstack cinder-volume[80174]: INFO cinder.volume.manager [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 14 03:13:41 devstack cinder-volume[80174]: WARNING stevedore.named [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 14 03:13:41 devstack cinder-volume[80174]: WARNING castellan.key_manager [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 14 03:13:41 devstack cinder-volume[80174]: WARNING cinder.keymgr.conf_key_mgr [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 14 03:13:41 devstack cinder-volume[80174]: INFO cinder.volume.manager [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_db.sqlalchemy.engines [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:13:41 devstack cinder-volume[80174]: INFO oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Starting 1 workers
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Started child 80264 {{(pid=80174) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Full set of CONF: {{(pid=80174) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] ******************************************************************************** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Configuration options gathered from: {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] ================================================================================ {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] allow_availability_zone_fallback = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] allow_compression_on_image_upload = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] allowed_direct_url_schemes     = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] api_rate_limit                 = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] auth_strategy                  = keystone {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_availability_zone      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_host                   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_name                   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_stats_polling_interval = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backup_api_class               = cinder.backup.api.API {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backup_name_template           = backup-%s {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backup_use_same_host           = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backup_use_temp_snapshot       = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] chap_password                  = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] chap_username                  =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_internal_tenant_project_id = 7953473a1a604ea7ad7c553cae8a75b2 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_internal_tenant_user_id = ae43879f9c3e49c0b66d7f5f427da401 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cluster                        = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] compression_format             = gzip {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] compute_api_class              = cinder.compute.nova.API {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] config_dir                     = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] config_source                  = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] control_exchange               = openstack {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] debug                          = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] default_availability_zone      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] default_group_type             = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] default_volume_type            = QuobyteHD {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] driver_client_cert             = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] driver_client_cert_key         = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] driver_data_namespace          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] driver_ssl_cert_path           = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] driver_ssl_cert_verify         = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] driver_use_ssl                 = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] enable_new_services            = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] enable_unsupported_driver      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] enabled_backends               = ['QuobyteHD'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] enforce_multipath_for_image_xfer = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] filter_function                = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80264]: INFO cinder.service [-] Starting cinder-volume node (version 26.2.1)
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_api_insecure            = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_api_servers             = ['http://192.168.122.143/image'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_api_ssl_compression     = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_ca_certificates_file    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_catalog_info            = image:glance:publicURL {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_certfile                = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_keyfile                 = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_num_retries             = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] glance_request_timeout         = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] goodness_function              = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] graceful_shutdown_timeout      = 5 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] group_api_class                = cinder.group.api.API {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] host                           = devstack {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_compress_on_upload       = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_conversion_address_space_limit = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_conversion_cpu_limit     = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_conversion_disable       = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_upload_use_cinder_backend = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_upload_use_internal_tenant = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_volume_cache_enabled     = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_volume_cache_max_count   = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] image_volume_cache_max_size_gb = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] init_host_max_objects_retrieval = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] instance_format                = [instance: %(uuid)s]  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] iscsi_iotype                   = fileio {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] iscsi_target_flags             =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] iscsi_write_cache              = on {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] iser_helper                    = tgtadm {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] iser_ip_address                = 192.168.122.143 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] iser_port                      = 3260 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_color                      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_config_append              = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_dir                        = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_file                       = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_options                    = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_rotate_interval            = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_rotate_interval_type       = days {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] log_rotation_type              = none {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] max_age                        = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] max_logfile_count              = 30 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] max_logfile_size_mb            = 200 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] max_over_subscription_ratio    = 20.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] message_reap_interval          = 86400 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] message_ttl                    = 2592000 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] migration_create_volume_timeout_secs = 300 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] monkey_patch                   = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] monkey_patch_modules           = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] my_ip                          = 192.168.122.143 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] no_snapshot_gb_quota           = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] num_iser_scan_tries            = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] num_shell_tries                = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] num_volume_device_scan_tries   = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] nvmeof_conn_info_version       = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] nvmet_ns_id                    = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] nvmet_port_id                  = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] osapi_max_limit                = 1000 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] osapi_volume_ext_list          = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] osapi_volume_listen_port       = 8776 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] osapi_volume_use_ssl           = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] osapi_volume_workers           = 2 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] per_volume_size_limit          = -1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] periodic_fuzzy_delay           = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] periodic_interval              = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] public_endpoint                = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] publish_errors                 = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] quota_backup_gigabytes         = 1000 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] quota_backups                  = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80264]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:13:41 devstack cinder-volume[80264]: INFO cinder.volume.manager [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Starting volume driver QuobyteDriver (1.1.13)
Nov 14 03:13:41 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.remotefs [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=80264) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] quota_gigabytes                = 1000 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] quota_groups                   = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] quota_snapshots                = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] quota_volumes                  = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] rate_limit_burst               = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] rate_limit_except_level        = CRITICAL {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] rate_limit_interval            = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] reinit_driver_count            = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] replication_device             = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] report_discard_supported       = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] report_interval                = 120 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] reservation_clean_interval     = 86400 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] reservation_expire             = 86400 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] reserved_image_namespaces      = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] reserved_percentage            = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] rpc_response_timeout           = 120 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] run_external_periodic_tasks    = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] scst_target_driver             = iscsi {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] scst_target_iqn_name           = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_down_time              = 720 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] shell_completion               = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] snapshot_name_template         = snapshot-%s {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] split_loggers                  = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] state_path                     = /opt/stack/data/cinder {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] storage_availability_zone      = nova {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] storage_protocol               = iSCSI {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] syslog_log_facility            = LOG_USER {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] target_helper                  = lioadm {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] target_ip_address              = 192.168.122.143 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] target_port                    = 3260 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] target_protocol                = iscsi {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] target_secondary_ip_addresses  = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] trace_flags                    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] transport_url                  = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] until_refresh                  = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] use_chap_auth                  = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] use_default_quota_class        = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] use_journal                    = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] use_json                       = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] use_multipath_for_image_xfer   = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] use_stderr                     = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] use_syslog                     = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] verify_glance_signatures       = enabled {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_api_class               = cinder.volume.api.API {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_backend_name            = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_clear                   = zero {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_clear_ionice            = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_clear_size              = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_copy_bps_limit          = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_dd_blocksize            = 1M {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_name_template           = volume-%s {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_service_inithost_offload = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volume_usage_audit_period      = month {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] watch_log_file                 = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] zoning_mode                    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_concurrency.disable_process_locking = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.admin_password = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.admin_token = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.admin_user  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.auth_port   = 35357 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.auth_protocol = https {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.auth_section = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.auth_type   = password {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.auth_uri    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.auth_version = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.cache       = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.certfile    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.delay_auth_decision = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.http_connect_timeout = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.identity_uri = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.include_service_catalog = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.insecure    = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.interface   = public {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.keyfile     = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_password =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcache_username =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.region_name = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.service_token_roles_required = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.service_type = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.token_cache_time = 300 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.backend                  = dogpile.cache.null {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.backend_argument         = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.backend_expiration_time  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.config_prefix            = cache.oslo {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.dead_timeout             = 60.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.debug_cache_backend      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.enable_retry_client      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.enable_socket_keepalive  = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.enabled                  = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.enforce_fips_mode        = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.expiration_time          = 600 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.hashclient_retry_attempts = 2 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=80264) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Nov 14 03:13:41 devstack cinder-volume[80264]: WARNING cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 14 03:13:41 devstack cinder-volume[80264]: WARNING cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 14 03:13:41 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Running cmd (subprocess): mount.quobyte {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_dead_retry      = 300 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_password        = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_pool_maxsize    = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_sasl_enabled    = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.memcache_username        = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.proxies                  = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.redis_db                 = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.redis_password           = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.redis_server             = localhost:6379 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.redis_socket_timeout     = 1.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.redis_username           = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.retry_attempts           = 2 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.retry_delay              = 0.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.socket_keepalive_count   = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.socket_keepalive_idle    = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.socket_keepalive_interval = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.tls_allowed_ciphers      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.tls_cafile               = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.tls_certfile             = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.tls_enabled              = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cache.tls_keyfile              = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] coordination.backend_url       = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.asyncio_connection    = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.asyncio_slave_connection = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.backend               = sqlalchemy {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.connection            = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.connection_debug      = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.connection_parameters =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.connection_recycle_time = 3600 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.connection_trace      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.db_inc_retry_interval = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.db_max_retries        = 20 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.db_max_retry_interval = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.db_retry_interval     = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.max_overflow          = 50 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.max_pool_size         = 5 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.max_retries           = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.mysql_wsrep_sync_wait = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.pool_timeout          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.retry_interval        = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.slave_connection      = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.sqlite_synchronous    = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] database.use_db_reconnect      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.connection_string     = messaging:// {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.enabled               = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.es_doc_type           = notification {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.es_scroll_size        = 10000 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.es_scroll_time        = 2m {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.filter_error_trace    = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.hmac_keys             = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.sentinel_service_name = mymaster {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.socket_timeout        = 0.1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.trace_requests        = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler.trace_sqlalchemy      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler_jaeger.process_tags   = {} {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler_jaeger.service_name_prefix = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] profiler_otlp.service_name_prefix = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.enforce_new_defaults = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: WARNING oslo_config.cfg [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.enforce_scope      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.policy_default_rule = default {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.policy_file        = policy.yaml {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] privsep_osbrick.group          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] privsep_osbrick.helper_command = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] privsep_osbrick.user           = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_sys_admin.group         = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_sys_admin.helper_command = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] cinder_sys_admin.user          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.auth_section      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.auth_type         = password {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.certfile          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.collect_timing    = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.insecure          = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.keyfile           = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.send_service_user_token = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.split_loggers     = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] service_user.timeout           = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.backend_availability_zone = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack quobyte-client[80270]: Reading configuration file: /etc/quobyte/client.cfg
Nov 14 03:13:41 devstack quobyte-client[80270]: Invalid parameters found, error: missing mount point.
Nov 14 03:13:41 devstack quobyte-client[80270]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 14 03:13:41 devstack quobyte-client[80270]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.chap_password = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.chap_username =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.driver_client_cert = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:13:41 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80264) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.driver_client_cert_key = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.driver_data_namespace = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80264]: INFO cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead ...
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 -c /etc/quobyte/client-cinder.cfg {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.driver_use_ssl = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.enable_unsupported_driver = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.extra_capabilities = {} {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.filter_function = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.goodness_function = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.iscsi_target_flags =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.iscsi_write_cache = on {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.iser_helper   = tgtadm {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.iser_ip_address = 192.168.122.143 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.iser_port     = 3260 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_host      =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_login     = admin {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_mount_options = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_password  = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_private_key =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_share_path =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack sudo[80271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 -c /etc/quobyte/client-cinder.cfg
Nov 14 03:13:41 devstack sudo[80271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:41 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.num_shell_tries = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.nvmet_port_id = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.quobyte_client_cfg = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.quobyte_volume_url = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.replication_device = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.report_discard_supported = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.reserved_percentage = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.scst_target_driver = iscsi {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.scst_target_iqn_name = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.storage_protocol = iSCSI {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.target_helper = tgtadm {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.target_ip_address = 192.168.122.143 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.target_port   = 3260 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.target_protocol = iscsi {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.trace_flags   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.unique_fqdn_network = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.use_chap_auth = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volume_backend_name = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volume_clear  = zero {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volume_clear_ionice = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volume_clear_size = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_reports.file_event_handler = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_reports.log_dir           = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.backend_availability_zone = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.backend_host         = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.chap_password        = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.chap_username        = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.chiscsi_conf         = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.driver_client_cert   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.driver_client_cert_key = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.driver_data_namespace = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.driver_use_ssl       = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.extra_capabilities   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.filter_function      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.goodness_function    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.iscsi_iotype         = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.iser_helper          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.iser_ip_address      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.iser_port            = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.iser_target_prefix   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_host             = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_login            = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_mount_options    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_password         = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_private_key      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_share_path       = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_ssh_port         = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.num_shell_tries      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.nvmet_port_id        = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.replication_device   = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.report_discard_supported = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.reserved_percentage  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.scst_target_driver   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.storage_protocol     = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.target_helper        = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.target_ip_address    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.target_port          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.target_prefix        = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.target_protocol      = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.trace_flags          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.use_chap_auth        = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volume_clear         = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volume_clear_size    = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] QuobyteHD.volumes_dir          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.ssl      = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_notifications.driver = [] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_notifications.retry = -1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] key_manager.fixed_key          = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.barbican_api_version  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.barbican_endpoint     = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.barbican_endpoint_type = public {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.barbican_region_name  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.cafile                = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.certfile              = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.collect_timing        = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.insecure              = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.keyfile               = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.number_of_retries     = 60 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.retry_delay           = 1 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.send_service_user_token = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.split_loggers         = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.timeout               = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.verify_ssl            = True {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican.verify_ssl_path       = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.auth_section = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.auth_type = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.cafile   = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.certfile = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.collect_timing = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.insecure = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.keyfile  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.split_loggers = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] barbican_service_user.timeout  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.approle_role_id          = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.approle_secret_id        = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.kv_mountpoint            = secret {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.kv_path                  = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.kv_version               = 2 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.namespace                = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.root_token_id            = **** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.ssl_ca_crt_file          = None {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.timeout                  = 60.0 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.use_ssl                  = False {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:42 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] ******************************************************************************** {{(pid=80174) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Nov 14 03:13:42 devstack sudo[80271]: pam_unix(sudo:session): session closed for user root
Nov 14 03:13:42 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.880s {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:42 devstack cinder-volume[80264]: INFO cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead succeeded
Nov 14 03:13:42 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80264) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:13:42 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.896s {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:13:42 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:42 devstack sudo[80388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:13:42 devstack sudo[80388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:13:43 devstack sudo[80388]: pam_unix(sudo:session): session closed for user root
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.413s {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:43 devstack cinder-volume[80264]: INFO cinder.volume.driver [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Driver hasn't implemented _init_vendor_properties()
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.volume.driver [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 230.98196411132812, 'free_capacity_gb': 230.98196411132812, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80264) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_db.sqlalchemy.engines [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG dbcounter [-] [80264] Writer thread running {{(pid=80264) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.db.sqlalchemy.api [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Building query based on filter {{(pid=80264) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.image.image_utils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80264) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Nov 14 03:13:43 devstack cinder-volume[80264]: INFO cinder.keymgr.migration [None req-da9d20c2-11bf-4174-bd2a-d88e33992304 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80264) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80264) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:43 devstack sudo[80402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:13:43 devstack sudo[80402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:13:43 devstack sudo[80402]: pam_unix(sudo:session): session closed for user root
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.443s {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.manager [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Notifying Schedulers of capabilities ... {{(pid=80264) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:13:43 devstack cinder-volume[80264]: INFO cinder.volume.manager [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Driver initialization completed successfully.
Nov 14 03:13:43 devstack cinder-volume[80264]: INFO cinder.manager [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Initiating service 3 cleanup
Nov 14 03:13:43 devstack cinder-volume[80264]: INFO cinder.manager [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Service 3 cleanup completed.
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.service [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Creating RPC server for service cinder-volume {{(pid=80264) start /opt/stack/cinder/cinder/service.py:239}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.service [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80264) start /opt/stack/cinder/cinder/service.py:245}}
Nov 14 03:13:43 devstack cinder-volume[80264]: INFO cinder.volume.manager [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Nov 14 03:13:43 devstack cinder-volume[80264]: WARNING cinder.volume.volume_utils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:13:43 devstack cinder-volume[80264]: WARNING cinder.volume.volume_utils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80264) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80264) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:13:43 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:43 devstack sudo[80421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:13:43 devstack sudo[80421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:13:44 devstack sudo[80421]: pam_unix(sudo:session): session closed for user root
Nov 14 03:13:44 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.541s {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:44 devstack cinder-volume[80264]: INFO cinder.volume.manager [None req-e380e05d-91e5-4ab3-adc4-a2fc448e571d None None] Driver post RPC initialization completed successfully.
Nov 14 03:13:47 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-f1c0f199-9edb-4263-be5c-5286d42a02b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:13:47 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-f1c0f199-9edb-4263-be5c-5286d42a02b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:13:47 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-f1c0f199-9edb-4263-be5c-5286d42a02b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80264) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:13:47 devstack cinder-volume[80264]: DEBUG cinder.volume.drivers.quobyte [None req-f1c0f199-9edb-4263-be5c-5286d42a02b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80264) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:13:47 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-f1c0f199-9edb-4263-be5c-5286d42a02b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80264) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:13:47 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-f1c0f199-9edb-4263-be5c-5286d42a02b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:47 devstack sudo[80524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:13:47 devstack sudo[80524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:13:47 devstack sudo[80524]: pam_unix(sudo:session): session closed for user root
Nov 14 03:13:47 devstack cinder-volume[80264]: DEBUG oslo_concurrency.processutils [None req-f1c0f199-9edb-4263-be5c-5286d42a02b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.416s {{(pid=80264) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:47 devstack cinder-volume[80264]: DEBUG cinder.manager [None req-f1c0f199-9edb-4263-be5c-5286d42a02b1 None None] Notifying Schedulers of capabilities ... {{(pid=80264) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:13:51 devstack cinder-volume[80174]: INFO oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Caught SIGTERM, stopping children
Nov 14 03:13:51 devstack cinder-volume[80174]: DEBUG oslo_concurrency.lockutils [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Acquiring lock "singleton_lock" {{(pid=80174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 14 03:13:51 devstack cinder-volume[80174]: DEBUG oslo_concurrency.lockutils [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Acquired lock "singleton_lock" {{(pid=80174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 14 03:13:51 devstack cinder-volume[80174]: DEBUG oslo_concurrency.lockutils [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Releasing lock "singleton_lock" {{(pid=80174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 14 03:13:51 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Stop services. {{(pid=80174) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Nov 14 03:13:51 devstack cinder-volume[80174]: DEBUG oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Killing children. {{(pid=80174) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Nov 14 03:13:51 devstack cinder-volume[80174]: INFO oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Waiting on 1 children to exit
Nov 14 03:13:52 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Acquiring lock "singleton_lock" {{(pid=80264) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 14 03:13:52 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Acquired lock "singleton_lock" {{(pid=80264) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 14 03:13:52 devstack cinder-volume[80264]: DEBUG oslo_concurrency.lockutils [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Releasing lock "singleton_lock" {{(pid=80264) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 14 03:13:52 devstack cinder-volume[80264]: WARNING amqp [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 14 03:13:52 devstack cinder-volume[80264]: WARNING amqp [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 14 03:13:52 devstack cinder-volume[80174]: INFO oslo_service.backend._eventlet.service [None req-2ec4deef-5afb-4084-9601-9a74dbd85877 None None] Child 80264 exited with status 0
Nov 14 03:13:54 devstack cinder-volume[80636]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80636) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 14 03:13:54 devstack cinder-volume[80636]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80636) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 14 03:13:54 devstack cinder-volume[80636]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80636) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 14 03:13:55 devstack cinder-volume[80636]: INFO dbcounter [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Registered counter for database cinder
Nov 14 03:13:55 devstack cinder-volume[80636]: DEBUG oslo_db.sqlalchemy.engines [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80636) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:13:55 devstack cinder-volume[80636]: DEBUG dbcounter [-] [80636] Writer thread running {{(pid=80636) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 14 03:13:55 devstack cinder-volume[80636]: INFO cinder.rpc [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 14 03:13:55 devstack cinder-volume[80636]: INFO cinder.rpc [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 14 03:13:55 devstack cinder-volume[80636]: DEBUG oslo_db.sqlalchemy.engines [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80636) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:13:55 devstack cinder-volume[80636]: INFO cinder.volume.manager [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Determined volume DB was empty at startup.
Nov 14 03:13:55 devstack cinder-volume[80636]: DEBUG cinder.volume.manager [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80636) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Nov 14 03:13:56 devstack cinder-volume[80636]: WARNING stevedore.named [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 14 03:13:56 devstack cinder-volume[80636]: WARNING castellan.key_manager [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 14 03:13:56 devstack cinder-volume[80636]: WARNING cinder.keymgr.conf_key_mgr [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 14 03:13:56 devstack cinder-volume[80636]: INFO cinder.volume.manager [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_db.sqlalchemy.engines [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80636) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:13:56 devstack cinder-volume[80636]: INFO oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Starting 1 workers
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Started child 80846 {{(pid=80636) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Full set of CONF: {{(pid=80636) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] ******************************************************************************** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Configuration options gathered from: {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] ================================================================================ {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] allow_availability_zone_fallback = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] allow_compression_on_image_upload = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] allowed_direct_url_schemes     = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] api_rate_limit                 = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] auth_strategy                  = keystone {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_availability_zone      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_host                   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_name                   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_stats_polling_interval = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backup_api_class               = cinder.backup.api.API {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backup_name_template           = backup-%s {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backup_use_same_host           = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80846]: INFO cinder.service [-] Starting cinder-volume node (version 26.2.1)
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backup_use_temp_snapshot       = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] chap_password                  = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] chap_username                  =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_internal_tenant_project_id = 7953473a1a604ea7ad7c553cae8a75b2 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_internal_tenant_user_id = ae43879f9c3e49c0b66d7f5f427da401 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cluster                        = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] compression_format             = gzip {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] compute_api_class              = cinder.compute.nova.API {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] config_dir                     = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] config_source                  = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] control_exchange               = openstack {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] debug                          = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] default_availability_zone      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] default_group_type             = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] default_volume_type            = QuobyteHD {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] driver_client_cert             = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] driver_client_cert_key         = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] driver_data_namespace          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] driver_ssl_cert_path           = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] driver_ssl_cert_verify         = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] driver_use_ssl                 = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] enable_new_services            = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] enable_unsupported_driver      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] enabled_backends               = ['QuobyteHD'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] enforce_multipath_for_image_xfer = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] filter_function                = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_api_insecure            = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_api_servers             = ['http://192.168.122.143/image'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_api_ssl_compression     = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_ca_certificates_file    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_catalog_info            = image:glance:publicURL {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_certfile                = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_keyfile                 = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_num_retries             = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] glance_request_timeout         = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] goodness_function              = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] graceful_shutdown_timeout      = 5 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] group_api_class                = cinder.group.api.API {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] host                           = devstack {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_compress_on_upload       = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_conversion_address_space_limit = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_conversion_cpu_limit     = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_conversion_disable       = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_upload_use_cinder_backend = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_upload_use_internal_tenant = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_volume_cache_enabled     = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Starting volume driver QuobyteDriver (1.1.13)
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_volume_cache_max_count   = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] image_volume_cache_max_size_gb = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] init_host_max_objects_retrieval = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] instance_format                = [instance: %(uuid)s]  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] iscsi_iotype                   = fileio {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] iscsi_target_flags             =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] iscsi_write_cache              = on {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] iser_helper                    = tgtadm {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=80846) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] iser_ip_address                = 192.168.122.143 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] iser_port                      = 3260 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_color                      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_config_append              = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_dir                        = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_file                       = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_options                    = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_rotate_interval            = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_rotate_interval_type       = days {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] log_rotation_type              = none {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] max_age                        = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] max_logfile_count              = 30 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] max_logfile_size_mb            = 200 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] max_over_subscription_ratio    = 20.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] message_reap_interval          = 86400 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] message_ttl                    = 2592000 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] migration_create_volume_timeout_secs = 300 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] monkey_patch                   = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] monkey_patch_modules           = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] my_ip                          = 192.168.122.143 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] no_snapshot_gb_quota           = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] num_iser_scan_tries            = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] num_shell_tries                = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] num_volume_device_scan_tries   = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] nvmeof_conn_info_version       = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] nvmet_ns_id                    = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] nvmet_port_id                  = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] osapi_max_limit                = 1000 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] osapi_volume_ext_list          = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] osapi_volume_listen_port       = 8776 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] osapi_volume_use_ssl           = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] osapi_volume_workers           = 2 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] per_volume_size_limit          = -1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] periodic_fuzzy_delay           = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] periodic_interval              = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] public_endpoint                = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] publish_errors                 = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] quota_backup_gigabytes         = 1000 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] quota_backups                  = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] quota_gigabytes                = 1000 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] quota_groups                   = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] quota_snapshots                = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] quota_volumes                  = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] rate_limit_burst               = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] rate_limit_except_level        = CRITICAL {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] rate_limit_interval            = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] reinit_driver_count            = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] replication_device             = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] report_discard_supported       = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] report_interval                = 120 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] reservation_clean_interval     = 86400 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] reservation_expire             = 86400 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] reserved_image_namespaces      = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] reserved_percentage            = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] rpc_response_timeout           = 120 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] run_external_periodic_tasks    = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] scst_target_driver             = iscsi {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] scst_target_iqn_name           = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_down_time              = 720 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] shell_completion               = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] snapshot_name_template         = snapshot-%s {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] split_loggers                  = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] state_path                     = /opt/stack/data/cinder {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] storage_availability_zone      = nova {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] storage_protocol               = iSCSI {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] syslog_log_facility            = LOG_USER {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] target_helper                  = lioadm {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] target_ip_address              = 192.168.122.143 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] target_port                    = 3260 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] target_protocol                = iscsi {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] target_secondary_ip_addresses  = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] trace_flags                    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] transport_url                  = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] until_refresh                  = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] use_chap_auth                  = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] use_default_quota_class        = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] use_journal                    = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] use_json                       = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] use_multipath_for_image_xfer   = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] use_stderr                     = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] use_syslog                     = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] verify_glance_signatures       = enabled {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_api_class               = cinder.volume.api.API {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_backend_name            = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_clear                   = zero {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_clear_ionice            = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_clear_size              = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_copy_bps_limit          = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_dd_blocksize            = 1M {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_name_template           = volume-%s {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_service_inithost_offload = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volume_usage_audit_period      = month {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] watch_log_file                 = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] zoning_mode                    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_concurrency.disable_process_locking = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.admin_password = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.admin_token = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.admin_user  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.auth_port   = 35357 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.auth_protocol = https {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.auth_section = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.auth_type   = password {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.auth_uri    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.auth_version = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.cache       = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.certfile    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.delay_auth_decision = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.http_connect_timeout = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.identity_uri = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.include_service_catalog = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.insecure    = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.interface   = public {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.keyfile     = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_password =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcache_username =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.region_name = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=80846) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Nov 14 03:13:56 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 14 03:13:56 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.service_token_roles_required = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.service_type = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Running cmd (subprocess): mount.quobyte {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.token_cache_time = 300 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] keystone_authtoken.www_authenticate_uri = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.backend                  = dogpile.cache.null {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.backend_argument         = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.backend_expiration_time  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.config_prefix            = cache.oslo {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.dead_timeout             = 60.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.debug_cache_backend      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.enable_retry_client      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.enable_socket_keepalive  = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.enabled                  = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.enforce_fips_mode        = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.expiration_time          = 600 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.hashclient_retry_attempts = 2 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.hashclient_retry_delay   = 1.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_dead_retry      = 300 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_password        = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_pool_maxsize    = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_sasl_enabled    = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_socket_timeout  = 1.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.memcache_username        = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.proxies                  = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.redis_db                 = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.redis_password           = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.redis_sentinel_service_name = mymaster {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.redis_server             = localhost:6379 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.redis_socket_timeout     = 1.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.redis_username           = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.retry_attempts           = 2 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.retry_delay              = 0.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.socket_keepalive_count   = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.socket_keepalive_idle    = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.socket_keepalive_interval = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.tls_allowed_ciphers      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.tls_cafile               = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.tls_certfile             = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.tls_enabled              = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cache.tls_keyfile              = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] coordination.backend_url       = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.asyncio_connection    = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.asyncio_slave_connection = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.backend               = sqlalchemy {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.connection            = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.connection_debug      = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.connection_parameters =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.connection_recycle_time = 3600 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.connection_trace      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.db_inc_retry_interval = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.db_max_retries        = 20 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.db_max_retry_interval = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.db_retry_interval     = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.max_overflow          = 50 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.max_pool_size         = 5 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.max_retries           = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.mysql_wsrep_sync_wait = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.pool_timeout          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.retry_interval        = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.slave_connection      = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.sqlite_synchronous    = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] database.use_db_reconnect      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.connection_string     = messaging:// {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.enabled               = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.es_doc_type           = notification {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.es_scroll_size        = 10000 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.es_scroll_time        = 2m {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.filter_error_trace    = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.hmac_keys             = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.sentinel_service_name = mymaster {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.socket_timeout        = 0.1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.trace_requests        = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler.trace_sqlalchemy      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler_jaeger.process_tags   = {} {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler_jaeger.service_name_prefix = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] profiler_otlp.service_name_prefix = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.enforce_new_defaults = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: WARNING oslo_config.cfg [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.enforce_scope      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.policy_default_rule = default {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.policy_file        = policy.yaml {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] privsep_osbrick.group          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] privsep_osbrick.helper_command = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] privsep_osbrick.user           = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_sys_admin.group         = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_sys_admin.helper_command = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] cinder_sys_admin.user          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.auth_section      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.auth_type         = password {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.certfile          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.collect_timing    = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.insecure          = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.keyfile           = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.send_service_user_token = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.split_loggers     = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] service_user.timeout           = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.backend_availability_zone = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.chap_password = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.chap_username =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.driver_client_cert = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.driver_client_cert_key = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.driver_data_namespace = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.driver_use_ssl = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.enable_unsupported_driver = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.extra_capabilities = {} {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.filter_function = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.goodness_function = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.iscsi_iotype  = fileio {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.iscsi_target_flags =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.iscsi_write_cache = on {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.iser_helper   = tgtadm {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.iser_ip_address = 192.168.122.143 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.iser_port     = 3260 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_host      =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_login     = admin {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_mount_options = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_password  = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_private_key =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_share_path =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.num_shell_tries = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.nvmet_port_id = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.quobyte_client_cfg = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.quobyte_volume_url = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.replication_device = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.report_discard_supported = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.reserved_percentage = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.scst_target_driver = iscsi {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.scst_target_iqn_name = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.storage_protocol = iSCSI {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.target_helper = tgtadm {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.target_ip_address = 192.168.122.143 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.target_port   = 3260 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.target_protocol = iscsi {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.trace_flags   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.unique_fqdn_network = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.use_chap_auth = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volume_backend_name = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volume_clear  = zero {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volume_clear_ionice = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volume_clear_size = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_reports.file_event_handler = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_reports.log_dir           = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.backend_availability_zone = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.backend_host         = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.chap_password        = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.chap_username        = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.chiscsi_conf         = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.driver_client_cert   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.driver_client_cert_key = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.driver_data_namespace = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.driver_use_ssl       = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.extra_capabilities   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.filter_function      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.goodness_function    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.iscsi_iotype         = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.iser_helper          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.iser_ip_address      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.iser_port            = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.iser_target_prefix   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_host             = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_login            = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_mount_options    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_password         = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_private_key      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_share_path       = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_ssh_port         = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.num_shell_tries      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.nvmet_port_id        = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.replication_device   = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.report_discard_supported = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.reserved_percentage  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.scst_target_driver   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.storage_protocol     = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.target_helper        = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.target_ip_address    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.target_port          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.target_prefix        = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.target_protocol      = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.trace_flags          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.use_chap_auth        = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volume_clear         = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volume_clear_size    = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] QuobyteHD.volumes_dir          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.ssl      = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack quobyte-client[80857]: Reading configuration file: /etc/quobyte/client.cfg
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack quobyte-client[80857]: Invalid parameters found, error: missing mount point.
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_notifications.driver = [] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack quobyte-client[80857]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 14 03:13:56 devstack quobyte-client[80857]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_notifications.retry = -1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] oslo_messaging_notifications.transport_url = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] key_manager.fixed_key          = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.barbican_api_version  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.barbican_endpoint     = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.barbican_endpoint_type = public {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.barbican_region_name  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.cafile                = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.certfile              = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.collect_timing        = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.insecure              = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.keyfile               = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.number_of_retries     = 60 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.retry_delay           = 1 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.send_service_user_token = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] CMD "mount.quobyte" returned: 1 in 0.163s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.split_loggers         = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.timeout               = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.verify_ssl            = True {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican.verify_ssl_path       = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.auth_section = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.auth_type = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.cafile   = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.certfile = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.collect_timing = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.insecure = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.keyfile  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.split_loggers = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] barbican_service_user.timeout  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.approle_role_id          = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.approle_secret_id        = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.kv_mountpoint            = secret {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.kv_path                  = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.kv_version               = 2 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.namespace                = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.root_token_id            = **** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.ssl_ca_crt_file          = None {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.timeout                  = 60.0 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.use_ssl                  = False {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 14 03:13:56 devstack cinder-volume[80636]: DEBUG oslo_service.backend._eventlet.service [None req-b0a032d8-1b98-43b1-a714-af95b3aca4ed None None] ******************************************************************************** {{(pid=80636) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:56 devstack sudo[80859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:13:56 devstack sudo[80859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:13:56 devstack sudo[80859]: pam_unix(sudo:session): session closed for user root
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.528s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:56 devstack cinder-volume[80846]: INFO cinder.volume.driver [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Driver hasn't implemented _init_vendor_properties()
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG cinder.volume.driver [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 230.98196411132812, 'free_capacity_gb': 230.98196411132812, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80846) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_db.sqlalchemy.engines [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writer thread running {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG cinder.db.sqlalchemy.api [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Building query based on filter {{(pid=80846) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80846) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:13:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:57 devstack cinder-volume[80846]: INFO cinder.keymgr.migration [None req-eafb6120-8602-4286-a3b9-0f04be07fd6f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 14 03:13:57 devstack sudo[80874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:13:57 devstack sudo[80874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.506s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:13:57 devstack sudo[80874]: pam_unix(sudo:session): session closed for user root
Nov 14 03:13:57 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Driver initialization completed successfully.
Nov 14 03:13:57 devstack cinder-volume[80846]: INFO cinder.manager [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Initiating service 3 cleanup
Nov 14 03:13:57 devstack cinder-volume[80846]: INFO cinder.manager [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Service 3 cleanup completed.
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG cinder.service [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Creating RPC server for service cinder-volume {{(pid=80846) start /opt/stack/cinder/cinder/service.py:239}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG cinder.service [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80846) start /opt/stack/cinder/cinder/service.py:245}}
Nov 14 03:13:57 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Nov 14 03:13:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:13:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:13:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:13:57 devstack sudo[80902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:13:57 devstack sudo[80902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:13:58 devstack sudo[80902]: pam_unix(sudo:session): session closed for user root
Nov 14 03:13:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.483s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:13:58 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4b166687-339c-4f9d-914a-aaf1b361bc4f None None] Driver post RPC initialization completed successfully.
Nov 14 03:14:06 devstack cinder-volume[80636]: DEBUG dbcounter [-] [80636] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=80636) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:14:07 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=2 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:14:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:14:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Flow 'volume_create_manager' (ed7c8849-2909-47c8-906c-177fe2ab18fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ecb109-a08d-494d-ada0-11c423bd4a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ecb109-a08d-494d-ada0-11c423bd4a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-64155606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f853efa-3e69-4c60-9a11-a219c4afdda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0734287a54d547cdba31ccffdd335254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:14:58Z,use_quota=True,user_id='6cecc48b44124d6f8fb927e5b1450ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f768ac-466a-432b-a2ce-d90162ccbe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f768ac-466a-432b-a2ce-d90162ccbe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f219f54f-3ebe-49f0-b971-94db2b09833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f219f54f-3ebe-49f0-b971-94db2b09833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f853efa-3e69-4c60-9a11-a219c4afdda4', 'volume_name': 'volume-6f853efa-3e69-4c60-9a11-a219c4afdda4', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c330210f-2bfd-4684-831b-3e1186a1b75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c330210f-2bfd-4684-831b-3e1186a1b75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12eb2ef-0738-4805-9eaa-c565a3bc2aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:14:57 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Volume 6f853efa-3e69-4c60-9a11-a219c4afdda4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f853efa-3e69-4c60-9a11-a219c4afdda4', 'volume_size': 1}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-64155606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f853efa-3e69-4c60-9a11-a219c4afdda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0734287a54d547cdba31ccffdd335254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:14:58Z,use_quota=True,user_id='6cecc48b44124d6f8fb927e5b1450ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Creating volume 6f853efa-3e69-4c60-9a11-a219c4afdda4 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:14:57 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:14:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:14:57 devstack sudo[81405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4 1073741824
Nov 14 03:14:57 devstack sudo[81405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:14:59 devstack sudo[81405]: pam_unix(sudo:session): session closed for user root
Nov 14 03:14:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4 1073741824" returned: 0 in 1.496s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:14:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:14:59 devstack sudo[81725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4
Nov 14 03:14:59 devstack sudo[81725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:15:00 devstack sudo[81725]: pam_unix(sudo:session): session closed for user root
Nov 14 03:15:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4" returned: 0 in 0.943s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:15:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] <== create_volume: return (2462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:15:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:15:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12eb2ef-0738-4805-9eaa-c565a3bc2aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f853efa-3e69-4c60-9a11-a219c4afdda4', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:15:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a66edc8-998a-4ef3-acac-9e6e5b76dacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:15:00 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Volume volume-6f853efa-3e69-4c60-9a11-a219c4afdda4 (6f853efa-3e69-4c60-9a11-a219c4afdda4): created successfully
Nov 14 03:15:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a66edc8-998a-4ef3-acac-9e6e5b76dacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:15:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Flow 'volume_create_manager' (ed7c8849-2909-47c8-906c-177fe2ab18fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:15:00 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5c30e6c2-0022-4433-ab5f-581d2904e251 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Created volume successfully.
Nov 14 03:15:10 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:15:10 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:15:54 devstack sudo[81959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:15:54 devstack sudo[81959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:15:54 devstack sudo[81959]: pam_unix(sudo:session): session closed for user root
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.473s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:15:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:15:58 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:15:58 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:15:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Flow 'volume_create_manager' (8e9c6686-2679-4608-8ae6-8debefeb56d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:15:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78f02ef-d1d4-43b2-8288-558526d2000e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78f02ef-d1d4-43b2-8288-558526d2000e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1135154717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0825e4639df74ee2beaa7db56bdb98ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:15:59Z,use_quota=True,user_id='b7b01247c2c54130be9c74783e82d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e95ae-a57a-4462-acc4-8b5ea6d64e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e95ae-a57a-4462-acc4-8b5ea6d64e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d4b7b4-1cbd-4d13-89e4-727c8d82f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d4b7b4-1cbd-4d13-89e4-727c8d82f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f', 'volume_name': 'volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f8a9af-7ac4-4c3a-9e35-ef8b3353e168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f8a9af-7ac4-4c3a-9e35-ef8b3353e168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204bf7cd-b139-43c0-9d5b-62e524bf303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:15:59 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Volume 8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f', 'volume_size': 1}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1135154717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0825e4639df74ee2beaa7db56bdb98ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:15:59Z,use_quota=True,user_id='b7b01247c2c54130be9c74783e82d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Creating volume 8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:15:59 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:15:59 devstack sudo[81976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f 1073741824
Nov 14 03:15:59 devstack sudo[81976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:15:59 devstack sudo[81976]: pam_unix(sudo:session): session closed for user root
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f 1073741824" returned: 0 in 0.608s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:15:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:15:59 devstack sudo[81984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f
Nov 14 03:15:59 devstack sudo[81984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:00 devstack sudo[81984]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f" returned: 0 in 0.480s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:16:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204bf7cd-b139-43c0-9d5b-62e524bf303d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f42dbd-7edc-4e56-a779-3bb3cdad3a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:00 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Volume volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f (8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f): created successfully
Nov 14 03:16:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f42dbd-7edc-4e56-a779-3bb3cdad3a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Flow 'volume_create_manager' (8e9c6686-2679-4608-8ae6-8debefeb56d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:16:00 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-00d8a5b8-e544-4d49-bfbe-34dc941591c3 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Created volume successfully.
Nov 14 03:16:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Flow 'volume_create_manager' (70f598cd-5069-44b8-9cce-ec0c47ec5d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a06ce1-ff90-4b62-b302-adcc62ea6e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a06ce1-ff90-4b62-b302-adcc62ea6e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-881511538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2cc584-3f4b-4e30-b107-d87d2dc3faf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243f303cf8114034a0eb52a20b645f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:16:04Z,use_quota=True,user_id='a1e56c912249405b974899de23bb0790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026b7eec-c4d7-4437-8860-e2f14194dfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026b7eec-c4d7-4437-8860-e2f14194dfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b20d653-f5f3-4a55-b95f-38d3369486a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b20d653-f5f3-4a55-b95f-38d3369486a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2cc584-3f4b-4e30-b107-d87d2dc3faf5', 'volume_name': 'volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3bb9c6-568a-4e15-a60b-99123f6cb410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3bb9c6-568a-4e15-a60b-99123f6cb410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb53caba-81f9-4961-8503-9057c169709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:03 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Volume ef2cc584-3f4b-4e30-b107-d87d2dc3faf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5', 'volume_size': 1}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-881511538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2cc584-3f4b-4e30-b107-d87d2dc3faf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243f303cf8114034a0eb52a20b645f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:16:04Z,use_quota=True,user_id='a1e56c912249405b974899de23bb0790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Creating volume ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:16:03 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:16:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:03 devstack sudo[82027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 1073741824
Nov 14 03:16:03 devstack sudo[82027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:04 devstack sudo[82027]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 1073741824" returned: 0 in 0.688s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:04 devstack sudo[82036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5
Nov 14 03:16:04 devstack sudo[82036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:04 devstack sudo[82036]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5" returned: 0 in 0.437s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:16:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb53caba-81f9-4961-8503-9057c169709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49678b9a-d990-4c4c-b0cb-2838ac6a581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:05 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Volume volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 (ef2cc584-3f4b-4e30-b107-d87d2dc3faf5): created successfully
Nov 14 03:16:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49678b9a-d990-4c4c-b0cb-2838ac6a581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Flow 'volume_create_manager' (70f598cd-5069-44b8-9cce-ec0c47ec5d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:16:05 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-86615662-a0b6-4c9d-b888-59586c7baeac tempest-AttachVolumeTestJSON-1434321382 None] Created volume successfully.
Nov 14 03:16:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:05 devstack cinder-volume[80846]: INFO oslo.privsep.daemon [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5yz52ibt/privsep.sock']
Nov 14 03:16:05 devstack sudo[82068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5yz52ibt/privsep.sock
Nov 14 03:16:05 devstack sudo[82068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:06 devstack sudo[82068]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:06 devstack cinder-volume[80846]: INFO oslo.privsep.daemon [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Spawned new privsep daemon via rootwrap
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Accepted privsep connection to /tmp/tmp5yz52ibt/privsep.sock {{(pid=80846) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Nov 14 03:16:06 devstack cinder-volume[80846]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 03:16:06 devstack cinder-volume[80846]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 03:16:06 devstack cinder-volume[80846]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 03:16:06 devstack cinder-volume[80846]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82078
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1466fb27-3534-44f5-86cb-cc596391865c]: (2,) {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e152993-6ac5-4e79-8d66-91a80fc9d917]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:06 devstack sudo[82080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f
Nov 14 03:16:06 devstack sudo[82080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Flow 'volume_create_manager' (9dc3b0e5-eb7b-4a7e-8242-d0785bbca571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f75490-015c-4303-9b85-337630b89848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f75490-015c-4303-9b85-337630b89848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-1377603817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8207f75-baea-4197-8fc4-ed7a1fb5007b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c53232e3b2d4b8b887cbbf34c4947dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:16:07Z,use_quota=True,user_id='1c4c0af8b6f34ce08aa1b168a2cb8f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3953f8d2-fe98-44e1-8e22-31fccfe65387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3953f8d2-fe98-44e1-8e22-31fccfe65387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c7a6db-e862-40c8-85cc-ae0573ba29f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c7a6db-e862-40c8-85cc-ae0573ba29f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8207f75-baea-4197-8fc4-ed7a1fb5007b', 'volume_name': 'volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a2f13e-7eb1-4b3e-95db-43631afd819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a2f13e-7eb1-4b3e-95db-43631afd819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1184f5f8-4fb0-4be3-81ba-5bff5e0d42c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:06 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Volume f8207f75-baea-4197-8fc4-ed7a1fb5007b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b', 'volume_size': 1}
Nov 14 03:16:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:07 devstack sudo[82080]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f" returned: 0 in 0.683s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.863s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-1377603817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8207f75-baea-4197-8fc4-ed7a1fb5007b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c53232e3b2d4b8b887cbbf34c4947dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:16:07Z,use_quota=True,user_id='1c4c0af8b6f34ce08aa1b168a2cb8f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Creating volume f8207f75-baea-4197-8fc4-ed7a1fb5007b {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:16:07 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:07 devstack sudo[82086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b 1073741824
Nov 14 03:16:07 devstack sudo[82086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b679f07b-0d83-4b8d-88e7-ec34621bd3df', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:16:07 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:07 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-ca0fcdb9-9691-4cf7-b2ed-ce6a296c4461 req-a743d811-4210-4480-bec3-da185ed478d2 tempest-AttachSCSIVolumeTestJSON-1132529239 None] attachment_update completed successfully.
Nov 14 03:16:07 devstack sudo[82086]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b 1073741824" returned: 0 in 0.706s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:08 devstack sudo[82159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b
Nov 14 03:16:08 devstack sudo[82159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:08 devstack sudo[82159]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b" returned: 0 in 0.513s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1184f5f8-4fb0-4be3-81ba-5bff5e0d42c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f808c4-0c7b-44ee-9c53-944b0304a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:16:08 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Volume volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b (f8207f75-baea-4197-8fc4-ed7a1fb5007b): created successfully
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f808c4-0c7b-44ee-9c53-944b0304a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Flow 'volume_create_manager' (9dc3b0e5-eb7b-4a7e-8242-d0785bbca571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:16:08 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-90a87901-0ff5-4381-801e-d79d5193c48e tempest-ServerActionsTestOtherB-1038024843 None] Created volume successfully.
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-3ab018af-cc03-49cf-be7f-7cdc1888ad86 req-68702516-5a28-4db5-a298-fdaca45810ca tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-3ab018af-cc03-49cf-be7f-7cdc1888ad86 req-68702516-5a28-4db5-a298-fdaca45810ca tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9579cd0d-5ce4-4324-8266-383a92bc363d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:16:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-3ab018af-cc03-49cf-be7f-7cdc1888ad86 req-68702516-5a28-4db5-a298-fdaca45810ca tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:09 devstack sudo[82487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5
Nov 14 03:16:09 devstack sudo[82487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:09 devstack sudo[82487]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-3ab018af-cc03-49cf-be7f-7cdc1888ad86 req-68702516-5a28-4db5-a298-fdaca45810ca tempest-AttachVolumeTestJSON-1434321382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5" returned: 0 in 0.594s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-3ab018af-cc03-49cf-be7f-7cdc1888ad86 req-68702516-5a28-4db5-a298-fdaca45810ca tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.605s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-3ab018af-cc03-49cf-be7f-7cdc1888ad86 req-68702516-5a28-4db5-a298-fdaca45810ca tempest-AttachVolumeTestJSON-1434321382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8531109f-0a79-4a55-b031-fef9eedd53a0', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:16:09 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-3ab018af-cc03-49cf-be7f-7cdc1888ad86 req-68702516-5a28-4db5-a298-fdaca45810ca tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:09 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-3ab018af-cc03-49cf-be7f-7cdc1888ad86 req-68702516-5a28-4db5-a298-fdaca45810ca tempest-AttachVolumeTestJSON-1434321382 None] attachment_update completed successfully.
Nov 14 03:16:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-9217c891-caaa-4add-b6c4-3baf21c76952 req-97c5a58a-65ae-407c-97c2-519294d8c668 tempest-ServerActionsTestOtherB-1038024843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-9217c891-caaa-4add-b6c4-3baf21c76952 req-97c5a58a-65ae-407c-97c2-519294d8c668 tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b18bec5-2501-4df8-8b62-849f296541fa]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:16:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-9217c891-caaa-4add-b6c4-3baf21c76952 req-97c5a58a-65ae-407c-97c2-519294d8c668 tempest-ServerActionsTestOtherB-1038024843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:12 devstack sudo[82520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b
Nov 14 03:16:12 devstack sudo[82520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:12 devstack sudo[82520]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-9217c891-caaa-4add-b6c4-3baf21c76952 req-97c5a58a-65ae-407c-97c2-519294d8c668 tempest-ServerActionsTestOtherB-1038024843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b" returned: 0 in 0.599s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-9217c891-caaa-4add-b6c4-3baf21c76952 req-97c5a58a-65ae-407c-97c2-519294d8c668 tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.616s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-9217c891-caaa-4add-b6c4-3baf21c76952 req-97c5a58a-65ae-407c-97c2-519294d8c668 tempest-ServerActionsTestOtherB-1038024843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f6ca8ce-a7d6-45b6-b3d5-dd691b6e1731', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:16:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-9217c891-caaa-4add-b6c4-3baf21c76952 req-97c5a58a-65ae-407c-97c2-519294d8c668 tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:12 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-9217c891-caaa-4add-b6c4-3baf21c76952 req-97c5a58a-65ae-407c-97c2-519294d8c668 tempest-ServerActionsTestOtherB-1038024843 None] attachment_update completed successfully.
Nov 14 03:16:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-dad1622f-a97b-417d-9e6a-5ee232d9d33c req-30f1ffb5-565f-4853-a133-bdb641d57302 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-dad1622f-a97b-417d-9e6a-5ee232d9d33c req-30f1ffb5-565f-4853-a133-bdb641d57302 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-dad1622f-a97b-417d-9e6a-5ee232d9d33c req-30f1ffb5-565f-4853-a133-bdb641d57302 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Terminate volume connection completed successfully.
Nov 14 03:16:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-dad1622f-a97b-417d-9e6a-5ee232d9d33c req-30f1ffb5-565f-4853-a133-bdb641d57302 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Deleting attachment b679f07b-0d83-4b8d-88e7-ec34621bd3df. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:16:22 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=21,cinder:UPDATE=8,cinder:DELETE=3 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:16:23 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=14,cinder:SELECT=21 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Acquiring lock "cinder-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "cinder-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:16:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Acquiring lock "cinder-quobyte-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "cinder-quobyte-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3041f2-faf3-4561-9e62-8d52a11eae45]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:24 devstack sudo[82723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f
Nov 14 03:16:24 devstack sudo[82723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-b7729b44-82c6-4015-9e7d-062048ecb192 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-b7729b44-82c6-4015-9e7d-062048ecb192 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a9d4c-ff83-4294-8423-b5cb1ea4bb59]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-b7729b44-82c6-4015-9e7d-062048ecb192 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:24 devstack sudo[82739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4
Nov 14 03:16:24 devstack sudo[82739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:24 devstack sudo[82723]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f" returned: 0 in 0.607s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:24 devstack sudo[82750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f
Nov 14 03:16:24 devstack sudo[82750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:25 devstack sudo[82739]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-b7729b44-82c6-4015-9e7d-062048ecb192 tempest-VolumesAssistedSnapshotsTest-1275656139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4" returned: 0 in 0.579s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-b7729b44-82c6-4015-9e7d-062048ecb192 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.599s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-b7729b44-82c6-4015-9e7d-062048ecb192 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-6f853efa-3e69-4c60-9a11-a219c4afdda4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '141be778-4324-4ea9-99f7-5d723f1d9572', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:16:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-b7729b44-82c6-4015-9e7d-062048ecb192 tempest-VolumesAssistedSnapshotsTest-1275656139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:25 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-b7729b44-82c6-4015-9e7d-062048ecb192 tempest-VolumesAssistedSnapshotsTest-1275656139 None] attachment_update completed successfully.
Nov 14 03:16:25 devstack sudo[82750]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f" returned: 0 in 0.558s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "cinder-quobyte-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f" released by "delete_volume" :: held 1.192s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:16:25 devstack cinder-volume[80846]: WARNING cinder.quota [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:16:25 devstack cinder-volume[80846]: WARNING cinder.quota [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Created reservations ['8c3fe3e4-41d7-4d8a-b8d4-1f481cf92cf4', '600599ed-dc1c-46b7-a36a-7e443bf5d0c4', '7cc86544-5778-4369-8a1d-ed52c38f99db', 'f0f1376b-9391-42b8-98b3-fee541698f1c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:25 devstack sudo[82779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:16:25 devstack sudo[82779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:26 devstack sudo[82779]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.624s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:26 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:16:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Deleted volume successfully.
Nov 14 03:16:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-3d017386-96e3-4f39-9516-d2d53793df3a tempest-VolumesAssistedSnapshotsTest-1275656139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f4ba0365-08e9-4450-b75a-fae605043805 tempest-AttachSCSIVolumeTestJSON-1132529239 None] Lock "cinder-8beb1d4c-04ae-477c-8b45-6f37dbbb1e0f-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:16:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-3d017386-96e3-4f39-9516-d2d53793df3a tempest-VolumesAssistedSnapshotsTest-1275656139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-3d017386-96e3-4f39-9516-d2d53793df3a tempest-VolumesAssistedSnapshotsTest-1275656139 None] Terminate volume connection completed successfully.
Nov 14 03:16:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-04bde909-5f30-4c0a-857f-534560fe6a30 req-3d017386-96e3-4f39-9516-d2d53793df3a tempest-VolumesAssistedSnapshotsTest-1275656139 None] Deleting attachment 141be778-4324-4ea9-99f7-5d723f1d9572. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:16:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2b6e10be-6d5c-467e-af2f-20e42232286c tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2b6e10be-6d5c-467e-af2f-20e42232286c tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2b6e10be-6d5c-467e-af2f-20e42232286c tempest-ServerActionsTestOtherB-1038024843 None] Terminate volume connection completed successfully.
Nov 14 03:16:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2b6e10be-6d5c-467e-af2f-20e42232286c tempest-ServerActionsTestOtherB-1038024843 None] Deleting attachment 5f6ca8ce-a7d6-45b6-b3d5-dd691b6e1731. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:16:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2a1c2746-ed68-4f5e-a08b-825e30eded6b tempest-ServerActionsTestOtherB-1038024843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2a1c2746-ed68-4f5e-a08b-825e30eded6b tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:31 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5daf4-800c-41db-9f35-32a53a5853bc]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:16:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2a1c2746-ed68-4f5e-a08b-825e30eded6b tempest-ServerActionsTestOtherB-1038024843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:32 devstack sudo[82867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b
Nov 14 03:16:32 devstack sudo[82867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:32 devstack sudo[82867]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2a1c2746-ed68-4f5e-a08b-825e30eded6b tempest-ServerActionsTestOtherB-1038024843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b" returned: 0 in 0.650s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2a1c2746-ed68-4f5e-a08b-825e30eded6b tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.661s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2a1c2746-ed68-4f5e-a08b-825e30eded6b tempest-ServerActionsTestOtherB-1038024843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28ef4ed6-c466-47ba-adc6-d0a1dcac166c', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:16:32 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2a1c2746-ed68-4f5e-a08b-825e30eded6b tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:32 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-11da023b-a229-445a-a5c5-a1bb61fb74c9 req-2a1c2746-ed68-4f5e-a08b-825e30eded6b tempest-ServerActionsTestOtherB-1038024843 None] attachment_update completed successfully.
Nov 14 03:16:42 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=10,cinder:SELECT=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:16:42 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:16:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-6b466269-32e9-42af-8215-80ed8d97c53e tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-6b466269-32e9-42af-8215-80ed8d97c53e tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:43 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-6b466269-32e9-42af-8215-80ed8d97c53e tempest-ServerActionsTestOtherB-1038024843 None] Terminate volume connection completed successfully.
Nov 14 03:16:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-6b466269-32e9-42af-8215-80ed8d97c53e tempest-ServerActionsTestOtherB-1038024843 None] Deleting attachment 28ef4ed6-c466-47ba-adc6-d0a1dcac166c. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:16:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-43be5406-2d29-4cb7-8b7e-d7a1da3a2ee2 tempest-ServerActionsTestOtherB-1038024843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-43be5406-2d29-4cb7-8b7e-d7a1da3a2ee2 tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:51 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edc09e9-4731-41ec-908f-b19e43849daa]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:16:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-43be5406-2d29-4cb7-8b7e-d7a1da3a2ee2 tempest-ServerActionsTestOtherB-1038024843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:51 devstack sudo[83402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b
Nov 14 03:16:51 devstack sudo[83402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:51 devstack sudo[83402]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-43be5406-2d29-4cb7-8b7e-d7a1da3a2ee2 tempest-ServerActionsTestOtherB-1038024843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b" returned: 0 in 0.655s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-43be5406-2d29-4cb7-8b7e-d7a1da3a2ee2 tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.665s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-43be5406-2d29-4cb7-8b7e-d7a1da3a2ee2 tempest-ServerActionsTestOtherB-1038024843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1ee6f8a-8c52-4f23-b26e-0bf61e406401', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:16:51 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-43be5406-2d29-4cb7-8b7e-d7a1da3a2ee2 tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:16:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-04675dc3-62b2-46f7-95d0-595b031205b6 req-43be5406-2d29-4cb7-8b7e-d7a1da3a2ee2 tempest-ServerActionsTestOtherB-1038024843 None] attachment_update completed successfully.
Nov 14 03:16:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:16:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:16:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:16:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:16:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:16:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:16:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:16:54 devstack sudo[83822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:16:54 devstack sudo[83822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:16:55 devstack sudo[83822]: pam_unix(sudo:session): session closed for user root
Nov 14 03:16:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 1.010s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:16:55 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:01 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:17:01 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:17:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-a381709a-8044-437d-a07c-9664166c10df req-724d2033-d320-497c-93a3-82757ac8bfa1 tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-a381709a-8044-437d-a07c-9664166c10df req-724d2033-d320-497c-93a3-82757ac8bfa1 tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-a381709a-8044-437d-a07c-9664166c10df req-724d2033-d320-497c-93a3-82757ac8bfa1 tempest-ServerActionsTestOtherB-1038024843 None] Terminate volume connection completed successfully.
Nov 14 03:17:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-a381709a-8044-437d-a07c-9664166c10df req-724d2033-d320-497c-93a3-82757ac8bfa1 tempest-ServerActionsTestOtherB-1038024843 None] Deleting attachment f1ee6f8a-8c52-4f23-b26e-0bf61e406401. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:17:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Acquiring lock "cinder-f8207f75-baea-4197-8fc4-ed7a1fb5007b-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Lock "cinder-f8207f75-baea-4197-8fc4-ed7a1fb5007b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:04 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Acquiring lock "cinder-quobyte-f8207f75-baea-4197-8fc4-ed7a1fb5007b" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Lock "cinder-quobyte-f8207f75-baea-4197-8fc4-ed7a1fb5007b" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:04 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[49edb5c8-9940-4a3f-a02f-a97d07be601e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:04 devstack sudo[83925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b
Nov 14 03:17:04 devstack sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:04 devstack sudo[83925]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b" returned: 0 in 0.634s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:04 devstack sudo[83944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b
Nov 14 03:17:04 devstack sudo[83944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:05 devstack sudo[83944]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f8207f75-baea-4197-8fc4-ed7a1fb5007b" returned: 0 in 0.493s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Lock "cinder-quobyte-f8207f75-baea-4197-8fc4-ed7a1fb5007b" released by "delete_volume" :: held 1.151s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Created reservations ['f74bfa33-bbfe-4cda-b2fd-2ef114fe534e', '65ae2ba0-7de4-44b5-930b-2762cec47e2b', 'a2224e6f-08d8-4ebe-ad7a-d333a6d43e23', '5e6ac8b1-7b41-4ce1-9cd1-7f0d664f0b81'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:05 devstack sudo[83947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:05 devstack sudo[83947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:05 devstack sudo[83947]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.499s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:05 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Deleted volume successfully.
Nov 14 03:17:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ef8eef32-d7a0-477b-b8ca-ca06ed101bef tempest-ServerActionsTestOtherB-1038024843 None] Lock "cinder-f8207f75-baea-4197-8fc4-ed7a1fb5007b-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Flow 'volume_create_manager' (86fe09d7-8a03-4ca5-91b6-4b7f7e2a4847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd7ba22-2f13-4986-97df-65af01d27f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd7ba22-2f13-4986-97df-65af01d27f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1995588260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d233ea0-5252-49df-9566-a7aae6b467f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0adc909c550409386088d5d420244ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:11Z,use_quota=True,user_id='bd4c38eebb544786a172a5763d407673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c812c2ab-d4b4-4ba2-98cf-99bbcf39763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c812c2ab-d4b4-4ba2-98cf-99bbcf39763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfa20ed-d096-4c07-8581-f0f6a4995d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfa20ed-d096-4c07-8581-f0f6a4995d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d233ea0-5252-49df-9566-a7aae6b467f9', 'volume_name': 'volume-5d233ea0-5252-49df-9566-a7aae6b467f9', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec8ba63-6b34-4b25-b854-e83ffb01b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec8ba63-6b34-4b25-b854-e83ffb01b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3152a05a-8071-41c6-b2fe-e8454194cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Volume 5d233ea0-5252-49df-9566-a7aae6b467f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d233ea0-5252-49df-9566-a7aae6b467f9', 'volume_size': 1}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1995588260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d233ea0-5252-49df-9566-a7aae6b467f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0adc909c550409386088d5d420244ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:11Z,use_quota=True,user_id='bd4c38eebb544786a172a5763d407673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Creating volume 5d233ea0-5252-49df-9566-a7aae6b467f9 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:11 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:11 devstack sudo[84036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9 1073741824
Nov 14 03:17:11 devstack sudo[84036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:12 devstack sudo[84036]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9 1073741824" returned: 0 in 0.694s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:12 devstack sudo[84041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9
Nov 14 03:17:12 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Flow 'volume_create_manager' (1501c596-4d54-47ca-9f0d-e7496312ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a423d1-b93b-425b-9cbc-b56ef930a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a423d1-b93b-425b-9cbc-b56ef930a07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1653284914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9041f65-edc8-4ede-8741-5e0ae78235d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8691861c7d40424087ec2b9f9a77ecd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:13Z,use_quota=True,user_id='084166042bef48ed90ea423c6084c798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34c152f-1ecc-445c-9c58-17a6106044e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34c152f-1ecc-445c-9c58-17a6106044e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd8a308-b240-40fe-ba5d-3623bc4109f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd8a308-b240-40fe-ba5d-3623bc4109f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9041f65-edc8-4ede-8741-5e0ae78235d6', 'volume_name': 'volume-d9041f65-edc8-4ede-8741-5e0ae78235d6', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73e5341-f81e-42b9-8ef7-a8d5a6dffeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73e5341-f81e-42b9-8ef7-a8d5a6dffeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b431f154-da53-4186-8726-b4344466544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:12 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Volume d9041f65-edc8-4ede-8741-5e0ae78235d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9041f65-edc8-4ede-8741-5e0ae78235d6', 'volume_size': 1}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9" returned: 0 in 0.597s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1653284914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9041f65-edc8-4ede-8741-5e0ae78235d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8691861c7d40424087ec2b9f9a77ecd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:13Z,use_quota=True,user_id='084166042bef48ed90ea423c6084c798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Creating volume d9041f65-edc8-4ede-8741-5e0ae78235d6 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:12 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3152a05a-8071-41c6-b2fe-e8454194cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d233ea0-5252-49df-9566-a7aae6b467f9', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:12 devstack sudo[84044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6 1073741824
Nov 14 03:17:12 devstack sudo[84044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533ebde3-b44b-471f-8d3a-9050682bbd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Volume volume-5d233ea0-5252-49df-9566-a7aae6b467f9 (5d233ea0-5252-49df-9566-a7aae6b467f9): created successfully
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533ebde3-b44b-471f-8d3a-9050682bbd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Flow 'volume_create_manager' (86fe09d7-8a03-4ca5-91b6-4b7f7e2a4847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:12 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-925f3e3a-1f5c-44ed-96b2-9588518349e1 tempest-VolumesAdminNegativeTest-1225219786 None] Created volume successfully.
Nov 14 03:17:13 devstack sudo[84044]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6 1073741824" returned: 0 in 0.606s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:13 devstack sudo[84049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6
Nov 14 03:17:13 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Acquiring lock "cinder-5d233ea0-5252-49df-9566-a7aae6b467f9-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "cinder-5d233ea0-5252-49df-9566-a7aae6b467f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Acquiring lock "cinder-quobyte-5d233ea0-5252-49df-9566-a7aae6b467f9" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "cinder-quobyte-5d233ea0-5252-49df-9566-a7aae6b467f9" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[406b4032-9dc7-456f-afe4-1f7f20c841d9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:13 devstack sudo[84051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9
Nov 14 03:17:13 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:13 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b431f154-da53-4186-8726-b4344466544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9041f65-edc8-4ede-8741-5e0ae78235d6', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be3159-7629-4ed2-9ce4-9b0548345e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Volume volume-d9041f65-edc8-4ede-8741-5e0ae78235d6 (d9041f65-edc8-4ede-8741-5e0ae78235d6): created successfully
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be3159-7629-4ed2-9ce4-9b0548345e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Flow 'volume_create_manager' (1501c596-4d54-47ca-9f0d-e7496312ca76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-49f52e95-20d8-48f3-aa78-9d3f467a4eea req-16a83564-05f0-4a4b-86f8-bc2c8dd2765c tempest-VolumesGetTestJSON-148053914 None] Created volume successfully.
Nov 14 03:17:14 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9" returned: 0 in 0.581s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:14 devstack sudo[84057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9
Nov 14 03:17:14 devstack sudo[84057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:14 devstack sudo[84057]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5d233ea0-5252-49df-9566-a7aae6b467f9" returned: 0 in 0.518s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "cinder-quobyte-5d233ea0-5252-49df-9566-a7aae6b467f9" released by "delete_volume" :: held 1.130s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:14 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Created reservations ['9f7516d8-acdb-4d7a-8155-a029f8340fa9', 'a3a4aec3-db19-404c-912a-e777fc7f6c66', '88f68eb2-b94d-4797-824c-1e72185cc020', '40c50814-d44d-43e3-a2c3-fe4057eeb3ad'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:15 devstack sudo[84060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:15 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Acquiring lock "cinder-d9041f65-edc8-4ede-8741-5e0ae78235d6-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Lock "cinder-d9041f65-edc8-4ede-8741-5e0ae78235d6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:15 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Acquiring lock "cinder-quobyte-d9041f65-edc8-4ede-8741-5e0ae78235d6" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Lock "cinder-quobyte-d9041f65-edc8-4ede-8741-5e0ae78235d6" acquired by "delete_volume" :: waited 0.030s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5278860-4f16-4a1a-b116-22b9751ef81f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:15 devstack sudo[84062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6
Nov 14 03:17:15 devstack sudo[84062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:15 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.465s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:15 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Deleted volume successfully.
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f3a5fee5-9f49-4cfe-8167-4e0891a298f3 tempest-VolumesAdminNegativeTest-1225219786 None] Lock "cinder-5d233ea0-5252-49df-9566-a7aae6b467f9-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:15 devstack sudo[84062]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6" returned: 0 in 0.585s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:15 devstack sudo[84069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6
Nov 14 03:17:15 devstack sudo[84069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:16 devstack sudo[84069]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d9041f65-edc8-4ede-8741-5e0ae78235d6" returned: 0 in 0.547s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Lock "cinder-quobyte-d9041f65-edc8-4ede-8741-5e0ae78235d6" released by "delete_volume" :: held 1.156s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG cinder.quota [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Created reservations ['2a9c9acf-153e-420c-bf43-044ae85a5d0f', '4c12784b-b608-41e5-b9cd-50a9c623a30a', 'cbdb0890-59c4-4f82-a6c5-819d5467b2e6', '6d37b6de-90aa-4562-a4f2-e4a6be8ebd11'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:16 devstack sudo[84072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:16 devstack sudo[84072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:16 devstack sudo[84072]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.499s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG cinder.manager [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Deleted volume successfully.
Nov 14 03:17:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-eb735345-d1c0-4bc1-8db8-1ab2e71bd552 req-9f8e24c5-1ae1-424d-8945-d75475e59f68 tempest-VolumesGetTestJSON-148053914 None] Lock "cinder-d9041f65-edc8-4ede-8741-5e0ae78235d6-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:19 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Flow 'volume_create_manager' (e11e9b10-8532-4e9b-8dc9-02fd0311d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928f2372-7456-464a-b026-be59bac4bd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928f2372-7456-464a-b026-be59bac4bd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1436739500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f36aa5-db22-405a-a180-883c34a28ed1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a91905131a74b8299d6c5dac8c925c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:20Z,use_quota=True,user_id='65843dad32c64fac8eb6d12baa54da15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f17281-827f-4da1-8a90-7ed0c5c44707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f17281-827f-4da1-8a90-7ed0c5c44707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cce4e1-e7cd-4efb-8905-da9345b64392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cce4e1-e7cd-4efb-8905-da9345b64392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f36aa5-db22-405a-a180-883c34a28ed1', 'volume_name': 'volume-e8f36aa5-db22-405a-a180-883c34a28ed1', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c28c050-16a3-4ca9-834f-1ca44ef78586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c28c050-16a3-4ca9-834f-1ca44ef78586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02d5228-c39e-47c9-bfad-d3c2088509ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Volume e8f36aa5-db22-405a-a180-883c34a28ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f36aa5-db22-405a-a180-883c34a28ed1', 'volume_size': 1}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1436739500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f36aa5-db22-405a-a180-883c34a28ed1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a91905131a74b8299d6c5dac8c925c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:20Z,use_quota=True,user_id='65843dad32c64fac8eb6d12baa54da15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Creating volume e8f36aa5-db22-405a-a180-883c34a28ed1 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:19 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:19 devstack sudo[84146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1 1073741824
Nov 14 03:17:19 devstack sudo[84146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:20 devstack sudo[84146]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1 1073741824" returned: 0 in 0.548s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:20 devstack sudo[84151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1
Nov 14 03:17:20 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:20 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1" returned: 0 in 0.439s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02d5228-c39e-47c9-bfad-d3c2088509ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f36aa5-db22-405a-a180-883c34a28ed1', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e6f0a1-0b00-4003-a53b-a589a21b9472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:20 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Volume volume-e8f36aa5-db22-405a-a180-883c34a28ed1 (e8f36aa5-db22-405a-a180-883c34a28ed1): created successfully
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e6f0a1-0b00-4003-a53b-a589a21b9472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Flow 'volume_create_manager' (e11e9b10-8532-4e9b-8dc9-02fd0311d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:20 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2cd3b562-e8d2-48b7-b438-a90e6223932b tempest-VolumesTestJSON-1714201563 None] Created volume successfully.
Nov 14 03:17:22 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Flow 'volume_create_manager' (8b1bcb3d-ab1b-427b-8812-3b2a60cb8339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b6a358-d803-4b9e-8449-5379b3226df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b6a358-d803-4b9e-8449-5379b3226df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1526968148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0377f3-e622-45e3-957a-662c80fcdd9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a91905131a74b8299d6c5dac8c925c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:22Z,use_quota=True,user_id='65843dad32c64fac8eb6d12baa54da15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65d1955-c870-4fdb-b69e-0d4fb8a3a5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65d1955-c870-4fdb-b69e-0d4fb8a3a5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6627ef-eb27-4553-ac98-367ebcf10403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6627ef-eb27-4553-ac98-367ebcf10403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0377f3-e622-45e3-957a-662c80fcdd9e', 'volume_name': 'volume-6b0377f3-e622-45e3-957a-662c80fcdd9e', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d76c29-b86e-4fba-b8b2-cf521ad432cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d76c29-b86e-4fba-b8b2-cf521ad432cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac706e60-6b46-4c35-9bc5-8d8d91b7c474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:22 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Volume 6b0377f3-e622-45e3-957a-662c80fcdd9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0377f3-e622-45e3-957a-662c80fcdd9e', 'volume_size': 1}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1526968148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0377f3-e622-45e3-957a-662c80fcdd9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a91905131a74b8299d6c5dac8c925c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:22Z,use_quota=True,user_id='65843dad32c64fac8eb6d12baa54da15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Creating volume 6b0377f3-e622-45e3-957a-662c80fcdd9e {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:22 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:22 devstack sudo[84155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e 1073741824
Nov 14 03:17:22 devstack sudo[84155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:22 devstack sudo[84155]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e 1073741824" returned: 0 in 0.580s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:22 devstack sudo[84160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e
Nov 14 03:17:22 devstack sudo[84160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:23 devstack sudo[84160]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e" returned: 0 in 0.501s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac706e60-6b46-4c35-9bc5-8d8d91b7c474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0377f3-e622-45e3-957a-662c80fcdd9e', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bbedc7-0ba6-4b4a-8030-457a023ef740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:23 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Volume volume-6b0377f3-e622-45e3-957a-662c80fcdd9e (6b0377f3-e622-45e3-957a-662c80fcdd9e): created successfully
Nov 14 03:17:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bbedc7-0ba6-4b4a-8030-457a023ef740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Flow 'volume_create_manager' (8b1bcb3d-ab1b-427b-8812-3b2a60cb8339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ee666998-c8be-4e91-8243-238195eb9ea1 tempest-VolumesTestJSON-1714201563 None] Created volume successfully.
Nov 14 03:17:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Flow 'volume_create_manager' (799112fd-68bf-4697-aa5a-ded954bd4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818b5cd6-42f1-43f2-8f49-85dcdc1e506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818b5cd6-42f1-43f2-8f49-85dcdc1e506f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243073294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83b949a-3090-43d0-a2bb-b8fa62299f99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a91905131a74b8299d6c5dac8c925c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:24Z,use_quota=True,user_id='65843dad32c64fac8eb6d12baa54da15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bd6d25-d600-4a6c-8312-6854e6247286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bd6d25-d600-4a6c-8312-6854e6247286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b28ec-c5cb-483b-bad8-1d960cd4a450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b28ec-c5cb-483b-bad8-1d960cd4a450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83b949a-3090-43d0-a2bb-b8fa62299f99', 'volume_name': 'volume-d83b949a-3090-43d0-a2bb-b8fa62299f99', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408c6e21-225f-478a-bc99-9786310ca855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408c6e21-225f-478a-bc99-9786310ca855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586de843-656b-42fe-91e6-671d4f2c0839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:24 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Volume d83b949a-3090-43d0-a2bb-b8fa62299f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83b949a-3090-43d0-a2bb-b8fa62299f99', 'volume_size': 1}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243073294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83b949a-3090-43d0-a2bb-b8fa62299f99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a91905131a74b8299d6c5dac8c925c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:24Z,use_quota=True,user_id='65843dad32c64fac8eb6d12baa54da15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Creating volume d83b949a-3090-43d0-a2bb-b8fa62299f99 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:24 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:24 devstack sudo[84164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99 1073741824
Nov 14 03:17:24 devstack sudo[84164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:25 devstack sudo[84164]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99 1073741824" returned: 0 in 0.637s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:25 devstack sudo[84175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99
Nov 14 03:17:25 devstack sudo[84175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:25 devstack sudo[84175]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99" returned: 0 in 0.498s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586de843-656b-42fe-91e6-671d4f2c0839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83b949a-3090-43d0-a2bb-b8fa62299f99', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae9ca93-d30b-45a0-a473-233e13f431a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:25 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Volume volume-d83b949a-3090-43d0-a2bb-b8fa62299f99 (d83b949a-3090-43d0-a2bb-b8fa62299f99): created successfully
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae9ca93-d30b-45a0-a473-233e13f431a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Flow 'volume_create_manager' (799112fd-68bf-4697-aa5a-ded954bd4537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:25 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1a861704-6182-44a8-be1f-f55f42801b2d tempest-VolumesTestJSON-1714201563 None] Created volume successfully.
Nov 14 03:17:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Acquiring lock "cinder-d83b949a-3090-43d0-a2bb-b8fa62299f99-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Lock "cinder-d83b949a-3090-43d0-a2bb-b8fa62299f99-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Acquiring lock "cinder-quobyte-d83b949a-3090-43d0-a2bb-b8fa62299f99" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Lock "cinder-quobyte-d83b949a-3090-43d0-a2bb-b8fa62299f99" acquired by "delete_volume" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:27 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c05652e-7f97-4bce-b086-ca58d5a41180]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:27 devstack sudo[84180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99
Nov 14 03:17:27 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:27 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99" returned: 0 in 0.667s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:27 devstack sudo[84185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99
Nov 14 03:17:27 devstack sudo[84185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:28 devstack sudo[84185]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-d83b949a-3090-43d0-a2bb-b8fa62299f99" returned: 0 in 0.512s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Lock "cinder-quobyte-d83b949a-3090-43d0-a2bb-b8fa62299f99" released by "delete_volume" :: held 1.199s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Created reservations ['5f0dc226-5045-4697-b189-4447a8f21284', 'c2b9acac-9422-4c3e-ae22-e3137f30c6da', '5bcf19df-3d15-40d2-b974-fbeb07c3a214', 'ca3256fe-45a2-4d3d-abb9-29a49567d5bb'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:28 devstack sudo[84189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:28 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:29 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.494s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Deleted volume successfully.
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8c810655-5d17-4c02-8733-7fd74956303e tempest-VolumesTestJSON-1714201563 None] Lock "cinder-d83b949a-3090-43d0-a2bb-b8fa62299f99-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Acquiring lock "cinder-6b0377f3-e622-45e3-957a-662c80fcdd9e-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Lock "cinder-6b0377f3-e622-45e3-957a-662c80fcdd9e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:29 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Acquiring lock "cinder-quobyte-6b0377f3-e622-45e3-957a-662c80fcdd9e" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Lock "cinder-quobyte-6b0377f3-e622-45e3-957a-662c80fcdd9e" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d4cacf-7939-44a3-8e7f-c0a0d347fc84]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:29 devstack sudo[84193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e
Nov 14 03:17:29 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:30 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e" returned: 0 in 0.618s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:30 devstack sudo[84198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e
Nov 14 03:17:30 devstack sudo[84198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:30 devstack sudo[84198]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b0377f3-e622-45e3-957a-662c80fcdd9e" returned: 0 in 0.506s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Lock "cinder-quobyte-6b0377f3-e622-45e3-957a-662c80fcdd9e" released by "delete_volume" :: held 1.160s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Created reservations ['5798f8b6-d1d2-46e6-8a26-92a2febb3d44', 'f50f5269-5ba8-43de-8da8-931d62db4a7f', '480999ac-59ef-4768-a68a-cbc594fac64e', '54c0fa5a-982f-47f9-81c4-e4935a99e118'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:30 devstack sudo[84202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:30 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:31 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.522s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:31 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Deleted volume successfully.
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5803d70f-a904-4432-82ee-bbeeb0afa6c0 tempest-VolumesTestJSON-1714201563 None] Lock "cinder-6b0377f3-e622-45e3-957a-662c80fcdd9e-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Acquiring lock "cinder-e8f36aa5-db22-405a-a180-883c34a28ed1-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Lock "cinder-e8f36aa5-db22-405a-a180-883c34a28ed1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:31 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Acquiring lock "cinder-quobyte-e8f36aa5-db22-405a-a180-883c34a28ed1" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Lock "cinder-quobyte-e8f36aa5-db22-405a-a180-883c34a28ed1" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71bf1a4-1e7f-492e-8827-97a5d9937905]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:31 devstack sudo[84206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1
Nov 14 03:17:31 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:32 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1" returned: 0 in 0.643s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:32 devstack sudo[84211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1
Nov 14 03:17:32 devstack sudo[84211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:32 devstack sudo[84211]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e8f36aa5-db22-405a-a180-883c34a28ed1" returned: 0 in 0.500s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Lock "cinder-quobyte-e8f36aa5-db22-405a-a180-883c34a28ed1" released by "delete_volume" :: held 1.184s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Created reservations ['9509ea45-f36a-4de1-975e-cfe62631645b', '9af6b256-e048-4325-9473-388c151b00f0', '8d2c41e9-1cbe-4198-a7c1-c55331b72a56', 'd2163333-e8dd-474a-aa0a-61fbfc7e4c43'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:32 devstack sudo[84214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:32 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:33 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:33 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Deleted volume successfully.
Nov 14 03:17:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-29c058ce-70c4-4011-8d67-e8d9e0dfbab8 tempest-VolumesTestJSON-1714201563 None] Lock "cinder-e8f36aa5-db22-405a-a180-883c34a28ed1-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3c82f479-85e0-4db4-836f-327e0085ca4d tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:40 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3c82f479-85e0-4db4-836f-327e0085ca4d tempest-GroupsTest-663335222 None] Group tempest-Group1-732661064: creating
Nov 14 03:17:40 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3c82f479-85e0-4db4-836f-327e0085ca4d tempest-GroupsTest-663335222 None] Group tempest-Group1-732661064: created successfully
Nov 14 03:17:40 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3c82f479-85e0-4db4-836f-327e0085ca4d tempest-GroupsTest-663335222 None] Create group completed successfully.
Nov 14 03:17:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-de8ce2a2-38a3-4fff-9afc-213cd1d3bf08 tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-de8ce2a2-38a3-4fff-9afc-213cd1d3bf08 tempest-GroupsTest-663335222 None] Group tempest-Group2-595889167: creating
Nov 14 03:17:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-de8ce2a2-38a3-4fff-9afc-213cd1d3bf08 tempest-GroupsTest-663335222 None] Group tempest-Group2-595889167: created successfully
Nov 14 03:17:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-de8ce2a2-38a3-4fff-9afc-213cd1d3bf08 tempest-GroupsTest-663335222 None] Create group completed successfully.
Nov 14 03:17:42 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Flow 'volume_create_manager' (af1f1acf-8480-4ebf-b048-de2fed2fc4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd2d4e7-a055-49ab-bd3e-2d9e7669da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd2d4e7-a055-49ab-bd3e-2d9e7669da82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-316617881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=442ea879-a6dd-4e45-8436-c08944a13d78,host='devstack@QuobyteHD#QuobyteHD',id=007f5a0a-f171-49d0-85d2-3911a7f80cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c836f7538f4e67943be8bd2baffc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:43Z,use_quota=True,user_id='96e14103f10b4680b86a7a40098bd1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dd1debc-b312-4520-87e5-e6bbe178ca94),volume_type_id=6dd1debc-b312-4520-87e5-e6bbe178ca94)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0aa9f2-121c-4cf2-b308-32a74f60751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0aa9f2-121c-4cf2-b308-32a74f60751a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11977f84-f8e7-4298-bd67-49d758994cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11977f84-f8e7-4298-bd67-49d758994cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '007f5a0a-f171-49d0-85d2-3911a7f80cf2', 'volume_name': 'volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d303577-c429-4076-b1b1-6cfc2adeea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d303577-c429-4076-b1b1-6cfc2adeea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450a4f5d-5220-4685-a082-21158ead3cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:42 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Volume 007f5a0a-f171-49d0-85d2-3911a7f80cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2', 'volume_size': 1}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=442ea879-a6dd-4e45-8436-c08944a13d78,created_at=2025-11-14T02:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-316617881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=442ea879-a6dd-4e45-8436-c08944a13d78,host='devstack@QuobyteHD#QuobyteHD',id=007f5a0a-f171-49d0-85d2-3911a7f80cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c836f7538f4e67943be8bd2baffc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:43Z,use_quota=True,user_id='96e14103f10b4680b86a7a40098bd1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dd1debc-b312-4520-87e5-e6bbe178ca94),volume_type_id=6dd1debc-b312-4520-87e5-e6bbe178ca94)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Creating volume 007f5a0a-f171-49d0-85d2-3911a7f80cf2 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:42 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:42 devstack sudo[84218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2 1073741824
Nov 14 03:17:42 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:43 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2 1073741824" returned: 0 in 0.600s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:43 devstack sudo[84225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2
Nov 14 03:17:43 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:43 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2" returned: 0 in 0.525s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450a4f5d-5220-4685-a082-21158ead3cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33673a87-fde2-4434-93a0-6beef9588089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:43 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Volume volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2 (007f5a0a-f171-49d0-85d2-3911a7f80cf2): created successfully
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33673a87-fde2-4434-93a0-6beef9588089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Flow 'volume_create_manager' (af1f1acf-8480-4ebf-b048-de2fed2fc4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:43 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-53e6a1f2-3e19-4df1-be8e-4fc778e73e0e tempest-GroupsTest-663335222 None] Created volume successfully.
Nov 14 03:17:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Acquiring lock "cinder-quobyte-007f5a0a-f171-49d0-85d2-3911a7f80cf2" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Lock "cinder-quobyte-007f5a0a-f171-49d0-85d2-3911a7f80cf2" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:45 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1e368b-5c61-4e76-a3aa-7944ff7e85da]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:45 devstack sudo[84228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2
Nov 14 03:17:45 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:45 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2" returned: 0 in 0.627s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:45 devstack sudo[84233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2
Nov 14 03:17:45 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:46 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-007f5a0a-f171-49d0-85d2-3911a7f80cf2" returned: 0 in 0.492s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Lock "cinder-quobyte-007f5a0a-f171-49d0-85d2-3911a7f80cf2" released by "delete_volume" :: held 1.141s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Created reservations ['8f0d3db8-f9bb-4c0c-b699-dc60201496dc'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:46 devstack cinder-volume[80846]: WARNING cinder.quota [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1208899101 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1208899101, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:17:46 devstack cinder-volume[80846]: WARNING cinder.quota [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1208899101 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1208899101, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Created reservations ['4905f93c-ff75-406c-b959-20289cb0d88c', '65b77059-0560-4d8c-8af2-c44be85f4c7a', '2ac084bd-2dd4-406c-98cf-b4ce1cd3e901', '81cb0de0-b4a8-46ee-978c-acc2f26a2c58'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:46 devstack sudo[84236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:46 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:47 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.531s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1e497fda-edb6-4816-84d1-d32dbbb3703a tempest-GroupsTest-663335222 None] Delete group completed successfully.
Nov 14 03:17:47 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Created reservations ['7bbd1e51-0047-475b-861b-4a6fd637a5e9'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:47 devstack sudo[84239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:47 devstack sudo[84239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:48 devstack sudo[84239]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.575s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:48 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:48 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9b6168ea-c406-43d2-af33-003e99dc213e tempest-GroupsTest-663335222 None] Delete group completed successfully.
Nov 14 03:17:49 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5bff09d5-b5ff-4461-88e8-f2e7f44ddc70 tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:49 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5bff09d5-b5ff-4461-88e8-f2e7f44ddc70 tempest-GroupsTest-663335222 None] Group tempest-GroupsTest-Group-1175965706: creating
Nov 14 03:17:49 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5bff09d5-b5ff-4461-88e8-f2e7f44ddc70 tempest-GroupsTest-663335222 None] Group tempest-GroupsTest-Group-1175965706: created successfully
Nov 14 03:17:49 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5bff09d5-b5ff-4461-88e8-f2e7f44ddc70 tempest-GroupsTest-663335222 None] Create group completed successfully.
Nov 14 03:17:50 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Flow 'volume_create_manager' (dbf5f267-3c71-423c-a0cd-973528a75002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbaeaa37-9bcc-4c9a-9fbd-41cffcc3c310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbaeaa37-9bcc-4c9a-9fbd-41cffcc3c310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166790392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0a44909-aa29-48d8-b976-7b159a839b24,host='devstack@QuobyteHD#QuobyteHD',id=ced4f145-c499-4efa-b598-f1f9321678f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c836f7538f4e67943be8bd2baffc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:50Z,use_quota=True,user_id='96e14103f10b4680b86a7a40098bd1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(033b510e-d7eb-4db8-bc91-45ca0c8c4a1d),volume_type_id=033b510e-d7eb-4db8-bc91-45ca0c8c4a1d)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7d1985-ec73-4d1b-8d94-d4f30685a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7d1985-ec73-4d1b-8d94-d4f30685a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4b73bc-1b6b-4072-af99-0494a09b5399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4b73bc-1b6b-4072-af99-0494a09b5399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced4f145-c499-4efa-b598-f1f9321678f4', 'volume_name': 'volume-ced4f145-c499-4efa-b598-f1f9321678f4', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f1397c-91b4-417a-8002-8bbfec6429f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f1397c-91b4-417a-8002-8bbfec6429f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8901256a-db77-4083-a22c-3efb00a376cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:50 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Volume ced4f145-c499-4efa-b598-f1f9321678f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced4f145-c499-4efa-b598-f1f9321678f4', 'volume_size': 1}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c0a44909-aa29-48d8-b976-7b159a839b24,created_at=2025-11-14T02:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166790392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0a44909-aa29-48d8-b976-7b159a839b24,host='devstack@QuobyteHD#QuobyteHD',id=ced4f145-c499-4efa-b598-f1f9321678f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c836f7538f4e67943be8bd2baffc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:50Z,use_quota=True,user_id='96e14103f10b4680b86a7a40098bd1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(033b510e-d7eb-4db8-bc91-45ca0c8c4a1d),volume_type_id=033b510e-d7eb-4db8-bc91-45ca0c8c4a1d)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Creating volume ced4f145-c499-4efa-b598-f1f9321678f4 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:50 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:50 devstack sudo[84243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4 1073741824
Nov 14 03:17:50 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:51 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4 1073741824" returned: 0 in 0.637s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:51 devstack sudo[84248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4
Nov 14 03:17:51 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:51 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4" returned: 0 in 0.497s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8901256a-db77-4083-a22c-3efb00a376cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced4f145-c499-4efa-b598-f1f9321678f4', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2875a305-77bc-46b7-bd6b-1bd4a0104501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:51 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Volume volume-ced4f145-c499-4efa-b598-f1f9321678f4 (ced4f145-c499-4efa-b598-f1f9321678f4): created successfully
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2875a305-77bc-46b7-bd6b-1bd4a0104501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Flow 'volume_create_manager' (dbf5f267-3c71-423c-a0cd-973528a75002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-550fcec6-1025-4c01-98f9-e8ccaafcdd87 tempest-GroupsTest-663335222 None] Created volume successfully.
Nov 14 03:17:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Flow 'volume_create_manager' (9b35c181-fccd-49d7-947b-23426e1e9629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddbdb4e-0853-4647-949d-b834ccc5e6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddbdb4e-0853-4647-949d-b834ccc5e6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1086680312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848c8a57-41d1-485e-89bb-4214980eb9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d43d39d0d114b529439bd49b1eac185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:52Z,use_quota=True,user_id='1db0cf9ba07240efb23eec244718b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7295c2-8341-44bc-b8a9-05f2adc58d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7295c2-8341-44bc-b8a9-05f2adc58d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400e73f3-b693-4997-8c87-92e75b87fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400e73f3-b693-4997-8c87-92e75b87fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848c8a57-41d1-485e-89bb-4214980eb9c2', 'volume_name': 'volume-848c8a57-41d1-485e-89bb-4214980eb9c2', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117b2657-84a0-4777-88d2-f151bdd79fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117b2657-84a0-4777-88d2-f151bdd79fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c70b88-2401-4355-8978-60301809d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Volume 848c8a57-41d1-485e-89bb-4214980eb9c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848c8a57-41d1-485e-89bb-4214980eb9c2', 'volume_size': 1}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1086680312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848c8a57-41d1-485e-89bb-4214980eb9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d43d39d0d114b529439bd49b1eac185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:52Z,use_quota=True,user_id='1db0cf9ba07240efb23eec244718b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Creating volume 848c8a57-41d1-485e-89bb-4214980eb9c2 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:52 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:52 devstack sudo[84251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2 1073741824
Nov 14 03:17:52 devstack sudo[84251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:52 devstack sudo[84251]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2 1073741824" returned: 0 in 0.591s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:52 devstack sudo[84256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2
Nov 14 03:17:52 devstack sudo[84256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Flow 'volume_create_manager' (f0e53d14-ed4b-4064-8998-05ef2eb9b4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14994b4-74f1-4b99-aacd-c1046a662dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14994b4-74f1-4b99-aacd-c1046a662dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1443600800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0a44909-aa29-48d8-b976-7b159a839b24,host='devstack@QuobyteHD#QuobyteHD',id=4d7af49e-8ff1-4ea1-a7c7-163371b2dfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c836f7538f4e67943be8bd2baffc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:53Z,use_quota=True,user_id='96e14103f10b4680b86a7a40098bd1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(033b510e-d7eb-4db8-bc91-45ca0c8c4a1d),volume_type_id=033b510e-d7eb-4db8-bc91-45ca0c8c4a1d)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da22a52d-51f4-4a73-a4e1-04d11f1d7301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da22a52d-51f4-4a73-a4e1-04d11f1d7301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d1fab5-8b90-412f-873b-2b31c1dd8490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d1fab5-8b90-412f-873b-2b31c1dd8490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7af49e-8ff1-4ea1-a7c7-163371b2dfde', 'volume_name': 'volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb5c58b-cf94-4ee2-bfe7-bf848579566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb5c58b-cf94-4ee2-bfe7-bf848579566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53ef42b-a165-400a-8901-94cbb0ec0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:52 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Volume 4d7af49e-8ff1-4ea1-a7c7-163371b2dfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde', 'volume_size': 1}
Nov 14 03:17:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:53 devstack sudo[84256]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2" returned: 0 in 0.474s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.197s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c0a44909-aa29-48d8-b976-7b159a839b24,created_at=2025-11-14T02:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1443600800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0a44909-aa29-48d8-b976-7b159a839b24,host='devstack@QuobyteHD#QuobyteHD',id=4d7af49e-8ff1-4ea1-a7c7-163371b2dfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c836f7538f4e67943be8bd2baffc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:17:53Z,use_quota=True,user_id='96e14103f10b4680b86a7a40098bd1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(033b510e-d7eb-4db8-bc91-45ca0c8c4a1d),volume_type_id=033b510e-d7eb-4db8-bc91-45ca0c8c4a1d)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Creating volume 4d7af49e-8ff1-4ea1-a7c7-163371b2dfde {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:17:53 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c70b88-2401-4355-8978-60301809d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848c8a57-41d1-485e-89bb-4214980eb9c2', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:53 devstack sudo[84259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde 1073741824
Nov 14 03:17:53 devstack sudo[84259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af35c93-718c-4e7d-bc1b-48d81445a209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:53 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Volume volume-848c8a57-41d1-485e-89bb-4214980eb9c2 (848c8a57-41d1-485e-89bb-4214980eb9c2): created successfully
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af35c93-718c-4e7d-bc1b-48d81445a209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Flow 'volume_create_manager' (9b35c181-fccd-49d7-947b-23426e1e9629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-11ea0817-61d1-413f-9e3b-d447bdfb5991 tempest-TaggedAttachmentsTest-1871709631 None] Created volume successfully.
Nov 14 03:17:53 devstack sudo[84259]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde 1073741824" returned: 0 in 0.555s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:53 devstack sudo[84264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde
Nov 14 03:17:53 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:54 devstack sudo[84267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:17:54 devstack sudo[84267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:54 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde" returned: 0 in 0.495s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53ef42b-a165-400a-8901-94cbb0ec0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e6a448-58bd-4392-ab9b-7bb030b88cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:17:54 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Volume volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde (4d7af49e-8ff1-4ea1-a7c7-163371b2dfde): created successfully
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e6a448-58bd-4392-ab9b-7bb030b88cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Flow 'volume_create_manager' (f0e53d14-ed4b-4064-8998-05ef2eb9b4db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:17:54 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3480b378-2538-4e60-8001-b0dc5d0e00e4 tempest-GroupsTest-663335222 None] Created volume successfully.
Nov 14 03:17:54 devstack sudo[84267]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.539s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:17:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8aaa2673-1261-44f9-bf90-0d780dbe3eff tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8aaa2673-1261-44f9-bf90-0d780dbe3eff tempest-GroupsTest-663335222 None] Update group completed successfully.
Nov 14 03:17:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3baeb3d4-56df-4a96-92d2-393280fddc47 tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3baeb3d4-56df-4a96-92d2-393280fddc47 tempest-GroupsTest-663335222 None] Update group completed successfully.
Nov 14 03:17:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:17:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Acquiring lock "cinder-quobyte-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Lock "cinder-quobyte-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:57 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6246c09d-1d96-4290-b239-5b02e5575675]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:58 devstack sudo[84274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde
Nov 14 03:17:58 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:58 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde" returned: 0 in 0.573s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:58 devstack sudo[84279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde
Nov 14 03:17:58 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:59 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde" returned: 0 in 0.464s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Lock "cinder-quobyte-4d7af49e-8ff1-4ea1-a7c7-163371b2dfde" released by "delete_volume" :: held 1.060s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:17:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Acquiring lock "cinder-quobyte-ced4f145-c499-4efa-b598-f1f9321678f4" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:17:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Lock "cinder-quobyte-ced4f145-c499-4efa-b598-f1f9321678f4" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:17:59 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb352e1-b7bf-494e-8984-3ca7719e78d7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:17:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:59 devstack sudo[84282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4
Nov 14 03:17:59 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:17:59 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root
Nov 14 03:17:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4" returned: 0 in 0.565s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:17:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:17:59 devstack sudo[84287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4
Nov 14 03:17:59 devstack sudo[84287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:00 devstack sudo[84287]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ced4f145-c499-4efa-b598-f1f9321678f4" returned: 0 in 0.452s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Lock "cinder-quobyte-ced4f145-c499-4efa-b598-f1f9321678f4" released by "delete_volume" :: held 1.040s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Created reservations ['ed93be0f-0bda-48ac-a0c0-27b7024e171c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:18:00 devstack cinder-volume[80846]: WARNING cinder.quota [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1695145848 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1695145848, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:18:00 devstack cinder-volume[80846]: WARNING cinder.quota [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1695145848 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1695145848, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Created reservations ['ccd0ea2e-25ef-45a5-af8f-3b6336d3def6', 'c388fbb7-52f2-4790-8548-742ba1cb8d1c', 'd8218eb5-0469-4fa1-9f39-746aec44fef5', 'de3427b4-1579-4fd7-9e3d-146aeb1a836e'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Created reservations ['da150abc-12d5-4d93-a949-98bf1f951670', '0af0c762-08d1-467e-a762-698e0717ecc6', '8ff43a74-d9b2-47ad-9fab-7d16172006a5', 'a2bed670-4d1d-4ed6-876b-94c9c5a8079e'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:00 devstack sudo[84290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:18:00 devstack sudo[84290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:00 devstack sudo[84290]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.483s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:00 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:18:00 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ce586ee3-b4a6-482e-b30c-cd2f4ed63b7e tempest-GroupsTest-663335222 None] Delete group completed successfully.
Nov 14 03:18:04 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=82,cinder:UPDATE=99,cinder:INSERT=18,cinder:DELETE=6 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:18:04 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d5e22063-2e89-426e-aaef-c6ed3622c50a tempest-GroupsV320Test-623932840 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:18:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d5e22063-2e89-426e-aaef-c6ed3622c50a tempest-GroupsV320Test-623932840 None] Group tempest-GroupsV320Test-Group-968363525: creating
Nov 14 03:18:04 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=75,cinder:INSERT=21,cinder:UPDATE=107,cinder:DELETE=9 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:18:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d5e22063-2e89-426e-aaef-c6ed3622c50a tempest-GroupsV320Test-623932840 None] Group tempest-GroupsV320Test-Group-968363525: created successfully
Nov 14 03:18:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d5e22063-2e89-426e-aaef-c6ed3622c50a tempest-GroupsV320Test-623932840 None] Create group completed successfully.
Nov 14 03:18:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Created reservations ['530e672d-4688-4b64-a1f5-7264fc5370dc'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:06 devstack sudo[84320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:18:06 devstack sudo[84320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:06 devstack sudo[84320]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.422s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:06 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:18:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-123314dc-9140-46d2-9d5c-f44a54915720 tempest-GroupsV320Test-623932840 None] Delete group completed successfully.
Nov 14 03:18:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Flow 'volume_create_manager' (447348ef-568c-4719-975c-9825d47e435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d29fc31-00a9-4892-8268-c4faadae3b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d29fc31-00a9-4892-8268-c4faadae3b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-987639541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8df55ca-d30a-48df-8f5a-f2291995a942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a381cf8abb9e45a5836dd8806b90c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:18:12Z,use_quota=True,user_id='a103c854b7d045c99dd4064d9562b864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf96d92-d791-4f92-a5ed-c50e18c4867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf96d92-d791-4f92-a5ed-c50e18c4867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3660ed-836e-4088-ac8d-b516448fbe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3660ed-836e-4088-ac8d-b516448fbe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8df55ca-d30a-48df-8f5a-f2291995a942', 'volume_name': 'volume-c8df55ca-d30a-48df-8f5a-f2291995a942', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046939bc-9ad8-4395-810e-eda033878ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046939bc-9ad8-4395-810e-eda033878ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eba1c72-b88e-45ee-a77a-82493c7315d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume c8df55ca-d30a-48df-8f5a-f2291995a942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8df55ca-d30a-48df-8f5a-f2291995a942', 'volume_size': 1}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-987639541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8df55ca-d30a-48df-8f5a-f2291995a942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a381cf8abb9e45a5836dd8806b90c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:18:12Z,use_quota=True,user_id='a103c854b7d045c99dd4064d9562b864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Creating volume c8df55ca-d30a-48df-8f5a-f2291995a942 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:18:11 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:18:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:11 devstack sudo[84386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942 1073741824
Nov 14 03:18:11 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:12 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942 1073741824" returned: 0 in 0.549s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:12 devstack sudo[84391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942
Nov 14 03:18:12 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:12 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942" returned: 0 in 0.439s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eba1c72-b88e-45ee-a77a-82493c7315d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8df55ca-d30a-48df-8f5a-f2291995a942', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b295d44-9719-4697-a95c-4a760922f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume volume-c8df55ca-d30a-48df-8f5a-f2291995a942 (c8df55ca-d30a-48df-8f5a-f2291995a942): created successfully
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b295d44-9719-4697-a95c-4a760922f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Flow 'volume_create_manager' (447348ef-568c-4719-975c-9825d47e435a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:18:12 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-94607f4f-e9a0-4397-bfb0-0aa62779a595 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Created volume successfully.
Nov 14 03:18:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Acquiring lock "cinder-c8df55ca-d30a-48df-8f5a-f2291995a942-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:18:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "cinder-c8df55ca-d30a-48df-8f5a-f2291995a942-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:18:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:18:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Acquiring lock "cinder-quobyte-c8df55ca-d30a-48df-8f5a-f2291995a942" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:18:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "cinder-quobyte-c8df55ca-d30a-48df-8f5a-f2291995a942" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:18:13 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[395278c8-67f9-4bb9-9ba4-9bbd2ee96556]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:18:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:13 devstack sudo[84394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942
Nov 14 03:18:13 devstack sudo[84394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:13 devstack sudo[84394]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942" returned: 0 in 0.568s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:13 devstack sudo[84399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942
Nov 14 03:18:13 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:14 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c8df55ca-d30a-48df-8f5a-f2291995a942" returned: 0 in 0.499s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "cinder-quobyte-c8df55ca-d30a-48df-8f5a-f2291995a942" released by "delete_volume" :: held 1.090s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Created reservations ['4497637d-2d5f-44c8-9765-2da8a2084534', '74db3859-d789-4065-bab7-ad7a8b8f1166', 'f6b4eede-05f9-4517-b7b7-f8626001c9c4', 'eabef9e5-95af-420c-9f8d-a59badf46cf5'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:14 devstack sudo[84402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:18:14 devstack sudo[84402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:14 devstack sudo[84402]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.457s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:18:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Deleted volume successfully.
Nov 14 03:18:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64e7bac5-d473-49f6-8ee4-5355bc9fa706 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "cinder-c8df55ca-d30a-48df-8f5a-f2291995a942-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:18:15 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Flow 'volume_create_manager' (0f198533-f0da-4345-8b07-fc4e743b42bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf31f512-5c1e-4719-a710-0f637442f663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf31f512-5c1e-4719-a710-0f637442f663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-509516410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355a0fd4-1085-4a71-968c-75801df8a602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a381cf8abb9e45a5836dd8806b90c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:18:16Z,use_quota=True,user_id='a103c854b7d045c99dd4064d9562b864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483d11fe-390c-4abe-a9fd-f51aea1f0f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483d11fe-390c-4abe-a9fd-f51aea1f0f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc378ce8-988b-41a2-8640-d5de50cf2e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc378ce8-988b-41a2-8640-d5de50cf2e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355a0fd4-1085-4a71-968c-75801df8a602', 'volume_name': 'volume-355a0fd4-1085-4a71-968c-75801df8a602', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72f1d29-5651-4a61-ae8c-ecee63e01686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72f1d29-5651-4a61-ae8c-ecee63e01686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758faaff-7d53-4d4b-bdc7-72bad056c15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:15 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume 355a0fd4-1085-4a71-968c-75801df8a602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355a0fd4-1085-4a71-968c-75801df8a602', 'volume_size': 1}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-509516410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355a0fd4-1085-4a71-968c-75801df8a602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a381cf8abb9e45a5836dd8806b90c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:18:16Z,use_quota=True,user_id='a103c854b7d045c99dd4064d9562b864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Creating volume 355a0fd4-1085-4a71-968c-75801df8a602 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:18:15 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:18:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:15 devstack sudo[84406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602 1073741824
Nov 14 03:18:15 devstack sudo[84406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:16 devstack sudo[84406]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602 1073741824" returned: 0 in 0.531s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:16 devstack sudo[84411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602
Nov 14 03:18:16 devstack sudo[84411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:16 devstack sudo[84411]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602" returned: 0 in 0.458s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758faaff-7d53-4d4b-bdc7-72bad056c15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355a0fd4-1085-4a71-968c-75801df8a602', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421240cb-77b6-439b-b611-ce5f49ebe44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:16 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Volume volume-355a0fd4-1085-4a71-968c-75801df8a602 (355a0fd4-1085-4a71-968c-75801df8a602): created successfully
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421240cb-77b6-439b-b611-ce5f49ebe44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Flow 'volume_create_manager' (0f198533-f0da-4345-8b07-fc4e743b42bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:18:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ddcff165-6111-4ef3-b5cd-d61a7bee5157 tempest-VolumeQuotasAdminTestJSON-1299122570 None] Created volume successfully.
Nov 14 03:18:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9f45a84b-6ce6-400a-a914-afb896050ed3 tempest-VolumeQuotasAdminTestJSON-818375601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:18:18 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9f45a84b-6ce6-400a-a914-afb896050ed3 tempest-VolumeQuotasAdminTestJSON-818375601 None] Transfer volume completed successfully.
Nov 14 03:18:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Acquiring lock "cinder-355a0fd4-1085-4a71-968c-75801df8a602-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:18:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Lock "cinder-355a0fd4-1085-4a71-968c-75801df8a602-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:18:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:18:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Acquiring lock "cinder-quobyte-355a0fd4-1085-4a71-968c-75801df8a602" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:18:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Lock "cinder-quobyte-355a0fd4-1085-4a71-968c-75801df8a602" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:18:19 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[185d4628-dfb6-4b28-be89-8d5463d87fdd]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:18:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:19 devstack sudo[84448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602
Nov 14 03:18:19 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:19 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602" returned: 0 in 0.570s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:19 devstack sudo[84453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602
Nov 14 03:18:19 devstack sudo[84453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:20 devstack sudo[84453]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-355a0fd4-1085-4a71-968c-75801df8a602" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Lock "cinder-quobyte-355a0fd4-1085-4a71-968c-75801df8a602" released by "delete_volume" :: held 1.082s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Created reservations ['71ac2b9c-ae60-4491-9624-496e55421b4e', '3eceb73c-6adc-4dd8-add8-c42ed96b76d7', 'aeaac0fb-bb3f-4842-a2c6-c5bcf7e21b6f', '6e7941a9-f13f-4840-932f-03d2ef858c58'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:20 devstack sudo[84456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:18:20 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:20 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.450s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:18:20 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Deleted volume successfully.
Nov 14 03:18:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4745bb91-9e84-49c8-a50d-e75b0ccc6241 tempest-VolumeQuotasAdminTestJSON-1189323529 None] Lock "cinder-355a0fd4-1085-4a71-968c-75801df8a602-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:18:30 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=32,cinder:SELECT=20,cinder:INSERT=3,cinder:DELETE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:18:30 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=3 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:54 devstack sudo[84502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:18:54 devstack sudo[84502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:18:54 devstack sudo[84502]: pam_unix(sudo:session): session closed for user root
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:18:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:18:59 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (a36b3029-6c9c-46ce-8bed-c2a4a6a532e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3ea544-1e0d-408e-94aa-21396aeb1e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3ea544-1e0d-408e-94aa-21396aeb1e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1485827162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:00Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee4f11f-7f8f-44c0-a7e2-07a5c079d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee4f11f-7f8f-44c0-a7e2-07a5c079d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e3d7ea-d96e-4839-9a86-b95340ccdc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e3d7ea-d96e-4839-9a86-b95340ccdc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a', 'volume_name': 'volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63eb9ee0-e0b2-4114-b36d-6b98d89097b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63eb9ee0-e0b2-4114-b36d-6b98d89097b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d72369-8c44-4d5e-baa7-5293830ed09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:18:59 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Volume 2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a', 'volume_size': 1}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1485827162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:00Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Creating volume 2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:18:59 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:18:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:18:59 devstack sudo[84571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a 1073741824
Nov 14 03:18:59 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:00 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a 1073741824" returned: 0 in 0.790s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:00 devstack sudo[84591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a
Nov 14 03:19:00 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:01 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" returned: 0 in 0.582s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d72369-8c44-4d5e-baa7-5293830ed09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7433d146-5b30-4f7e-9567-0a736ecd38a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:01 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Volume volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a (2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a): created successfully
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7433d146-5b30-4f7e-9567-0a736ecd38a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (a36b3029-6c9c-46ce-8bed-c2a4a6a532e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c569c21e-fc46-4332-adff-0f0126ece3a0 tempest-VolumesActionsTest-181481048 None] Created volume successfully.
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5a362abc-57be-493d-851a-bb7c21910246 tempest-VolumesActionsTest-181481048 None] Acquiring lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" by "attach_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5a362abc-57be-493d-851a-bb7c21910246 tempest-VolumesActionsTest-181481048 None] Lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" acquired by "attach_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:01 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5a362abc-57be-493d-851a-bb7c21910246 tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5a362abc-57be-493d-851a-bb7c21910246 tempest-VolumesActionsTest-181481048 None] Attaching volume 2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a to instance 80f4bbee-7b2f-4e5f-a60f-e1a56933b808 at mountpoint /dev/vdb on host None.
Nov 14 03:19:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5a362abc-57be-493d-851a-bb7c21910246 tempest-VolumesActionsTest-181481048 None] Attach volume completed successfully.
Nov 14 03:19:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5a362abc-57be-493d-851a-bb7c21910246 tempest-VolumesActionsTest-181481048 None] Lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" released by "attach_volume" :: held 0.090s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Terminate volume connection completed successfully.
Nov 14 03:19:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-detach_volume" by "detach_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Detaching volume 2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a from instance 80f4bbee-7b2f-4e5f-a60f-e1a56933b808.
Nov 14 03:19:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Detach volume completed successfully.
Nov 14 03:19:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0f044f4f-2998-4099-9cf5-b01a5ad5a270 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b8ba7c9-2019-48cc-91f7-17d979646aed tempest-VolumesActionsTest-181481048 None] Acquiring lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-detach_volume" by "detach_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b8ba7c9-2019-48cc-91f7-17d979646aed tempest-VolumesActionsTest-181481048 None] Lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0b8ba7c9-2019-48cc-91f7-17d979646aed tempest-VolumesActionsTest-181481048 None] Volume detach called, but volume not attached.
Nov 14 03:19:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b8ba7c9-2019-48cc-91f7-17d979646aed tempest-VolumesActionsTest-181481048 None] Lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-detach_volume" released by "detach_volume" :: held 0.017s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Acquiring lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:04 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Acquiring lock "cinder-quobyte-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Lock "cinder-quobyte-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" acquired by "delete_volume" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:04 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796f159-68dc-43d0-b1a2-e961a58edd83]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:04 devstack sudo[84595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a
Nov 14 03:19:04 devstack sudo[84595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:05 devstack sudo[84595]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" returned: 0 in 0.601s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:05 devstack sudo[84606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a
Nov 14 03:19:05 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:05 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" returned: 0 in 0.467s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Lock "cinder-quobyte-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a" released by "delete_volume" :: held 1.090s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Created reservations ['88488ff9-8bdf-4db7-b3fa-c259ce611aaf', '124bb5ae-6957-4d0c-b462-c1acc1c1cebe', '9e79929b-fd73-4e11-b3e3-0df96ffcf046', '4bcb53b5-092d-4f41-acc4-eb393a92104d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:05 devstack sudo[84609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:05 devstack sudo[84609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:06 devstack sudo[84609]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.499s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:06 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Deleted volume successfully.
Nov 14 03:19:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0404f4c-fdbd-4cfe-9734-93286ac32e19 tempest-VolumesActionsTest-181481048 None] Lock "cinder-2d50b44a-d527-485c-ab3e-6b6cc1dd8d9a-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (d3015825-0083-4e0f-bea4-175ee6b0795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab822034-a411-4949-9e4a-b4cfd9c2fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab822034-a411-4949-9e4a-b4cfd9c2fd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244855931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6961ad68-cf6d-4e92-9abc-6b94907954bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:14Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a286774-e63b-4506-a19f-a8e041d00d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a286774-e63b-4506-a19f-a8e041d00d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e924629-f085-4de1-917c-9346781f5861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e924629-f085-4de1-917c-9346781f5861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6961ad68-cf6d-4e92-9abc-6b94907954bb', 'volume_name': 'volume-6961ad68-cf6d-4e92-9abc-6b94907954bb', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8e99dc-9e6c-4fe7-9de0-05a5d5ddcc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8e99dc-9e6c-4fe7-9de0-05a5d5ddcc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1008d9-295d-4852-8c76-99ce961f9b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Volume 6961ad68-cf6d-4e92-9abc-6b94907954bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6961ad68-cf6d-4e92-9abc-6b94907954bb', 'volume_size': 1}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244855931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6961ad68-cf6d-4e92-9abc-6b94907954bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:14Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Creating volume 6961ad68-cf6d-4e92-9abc-6b94907954bb {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:19:13 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:19:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:13 devstack sudo[84651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb 1073741824
Nov 14 03:19:13 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:14 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb 1073741824" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:14 devstack sudo[84656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb
Nov 14 03:19:14 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:14 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb" returned: 0 in 0.469s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1008d9-295d-4852-8c76-99ce961f9b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6961ad68-cf6d-4e92-9abc-6b94907954bb', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f113272a-080d-4286-ad5f-18e835e1fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:14 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Volume volume-6961ad68-cf6d-4e92-9abc-6b94907954bb (6961ad68-cf6d-4e92-9abc-6b94907954bb): created successfully
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f113272a-080d-4286-ad5f-18e835e1fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (d3015825-0083-4e0f-bea4-175ee6b0795e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-847ec12a-91c1-416b-a8f9-363588718e4e tempest-VolumesActionsTest-181481048 None] Created volume successfully.
Nov 14 03:19:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-6961ad68-cf6d-4e92-9abc-6b94907954bb-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-6961ad68-cf6d-4e92-9abc-6b94907954bb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:16 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-quobyte-6961ad68-cf6d-4e92-9abc-6b94907954bb" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-quobyte-6961ad68-cf6d-4e92-9abc-6b94907954bb" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:16 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ba3fbc-fe2a-459e-9277-0d5d880e112e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:16 devstack sudo[84660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb
Nov 14 03:19:16 devstack sudo[84660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:16 devstack sudo[84660]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb" returned: 0 in 0.580s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:16 devstack sudo[84666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb
Nov 14 03:19:16 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:17 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6961ad68-cf6d-4e92-9abc-6b94907954bb" returned: 0 in 0.481s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-quobyte-6961ad68-cf6d-4e92-9abc-6b94907954bb" released by "delete_volume" :: held 1.097s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Created reservations ['6279ee71-d938-404d-b498-49eb428fab17', 'ba32dbdc-8265-4cf5-9a95-33493c934983', 'df8b077a-c0b9-47cd-b06e-9d7d8e773bb6', '215449e4-3c07-4140-8032-ffaff293b256'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:17 devstack sudo[84703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:17 devstack sudo[84703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:17 devstack sudo[84703]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.491s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Deleted volume successfully.
Nov 14 03:19:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d01a2fa1-40f5-4312-838e-a7f87401b481 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-6961ad68-cf6d-4e92-9abc-6b94907954bb-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (ee731238-f935-4851-a00d-30e2e68a1670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0608ae5-edea-49cb-9b5e-84d6d03fc24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0608ae5-edea-49cb-9b5e-84d6d03fc24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929493795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64617de2-d2f8-49bd-a3d5-0d01fc37cf5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:19Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979e7bcb-8478-43b7-9cad-43660f16b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979e7bcb-8478-43b7-9cad-43660f16b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f28e33-9e29-40b6-a965-c5f06b45ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f28e33-9e29-40b6-a965-c5f06b45ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64617de2-d2f8-49bd-a3d5-0d01fc37cf5b', 'volume_name': 'volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348a7b9d-2094-41b2-a2c7-cca787b793d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348a7b9d-2094-41b2-a2c7-cca787b793d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14133dcb-42a5-47da-8c77-22b993649c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:18 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Volume 64617de2-d2f8-49bd-a3d5-0d01fc37cf5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b', 'volume_size': 1}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929493795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64617de2-d2f8-49bd-a3d5-0d01fc37cf5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:19Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Creating volume 64617de2-d2f8-49bd-a3d5-0d01fc37cf5b {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:19:18 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:19:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:18 devstack sudo[84706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b 1073741824
Nov 14 03:19:18 devstack sudo[84706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:19 devstack sudo[84706]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b 1073741824" returned: 0 in 0.575s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:19 devstack sudo[84711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b
Nov 14 03:19:19 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:19 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b" returned: 0 in 0.475s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14133dcb-42a5-47da-8c77-22b993649c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50a2fa0-25ba-40f8-8822-1089a2e5c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Volume volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b (64617de2-d2f8-49bd-a3d5-0d01fc37cf5b): created successfully
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50a2fa0-25ba-40f8-8822-1089a2e5c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (ee731238-f935-4851-a00d-30e2e68a1670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-88026d3e-d667-4d62-83a8-0a4c3f174ec6 tempest-VolumesActionsTest-181481048 None] Created volume successfully.
Nov 14 03:19:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-quobyte-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-quobyte-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:20 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe2960a-1e47-44c0-9edb-6cc568a67a91]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:20 devstack sudo[84763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b
Nov 14 03:19:20 devstack sudo[84763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:21 devstack sudo[84763]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b" returned: 0 in 0.555s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:21 devstack sudo[84768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b
Nov 14 03:19:21 devstack sudo[84768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:21 devstack sudo[84768]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b" returned: 0 in 0.508s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-quobyte-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b" released by "delete_volume" :: held 1.097s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:21 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Created reservations ['70f9bbc7-9e5d-4462-a8b6-e5c88bbc4986', '18f3b739-a7fb-4306-9828-c2760e0810d5', 'e7894a62-1b96-48b8-ab3a-ec646cf779aa', '21a67cbb-e18e-4e3c-89ba-0c40aa1990a9'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:22 devstack sudo[84771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:22 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:22 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.480s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:22 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Deleted volume successfully.
Nov 14 03:19:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-443c54e7-2700-48cc-a6a4-8c2dd22421d6 tempest-VolumesActionsTest-1565246839 None] Lock "cinder-64617de2-d2f8-49bd-a3d5-0d01fc37cf5b-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:23 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (bf129061-4832-4154-bb9c-3b8bcf562e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9564a16-4810-4676-abba-28d54f18ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9564a16-4810-4676-abba-28d54f18ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012080543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001cf61c-2e63-4556-9da4-742100e84c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:23Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68acb49d-97ae-43d4-8fbe-ebe00aa43bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68acb49d-97ae-43d4-8fbe-ebe00aa43bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0869fb7c-def2-4462-ba24-6ef265e83c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0869fb7c-def2-4462-ba24-6ef265e83c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001cf61c-2e63-4556-9da4-742100e84c3d', 'volume_name': 'volume-001cf61c-2e63-4556-9da4-742100e84c3d', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4906ca5-e4cb-47de-93ff-bd3159a48670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4906ca5-e4cb-47de-93ff-bd3159a48670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cf6a5f-c477-4377-9ca5-193384e7696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:23 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Volume 001cf61c-2e63-4556-9da4-742100e84c3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001cf61c-2e63-4556-9da4-742100e84c3d', 'volume_size': 1}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012080543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001cf61c-2e63-4556-9da4-742100e84c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:23Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Creating volume 001cf61c-2e63-4556-9da4-742100e84c3d {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:19:23 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:23 devstack sudo[84774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d 1073741824
Nov 14 03:19:23 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:23 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d 1073741824" returned: 0 in 0.624s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:23 devstack sudo[84779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d
Nov 14 03:19:23 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:24 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d" returned: 0 in 0.506s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:19:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cf6a5f-c477-4377-9ca5-193384e7696d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001cf61c-2e63-4556-9da4-742100e84c3d', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce15b119-9172-48f2-b378-82ee4f530fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:24 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Volume volume-001cf61c-2e63-4556-9da4-742100e84c3d (001cf61c-2e63-4556-9da4-742100e84c3d): created successfully
Nov 14 03:19:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce15b119-9172-48f2-b378-82ee4f530fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (bf129061-4832-4154-bb9c-3b8bcf562e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:24 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c48635f5-d1af-4b2e-890c-d7f88348a106 tempest-VolumesActionsTest-181481048 None] Created volume successfully.
Nov 14 03:19:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-001cf61c-2e63-4556-9da4-742100e84c3d-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Lock "cinder-001cf61c-2e63-4556-9da4-742100e84c3d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-quobyte-001cf61c-2e63-4556-9da4-742100e84c3d" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Lock "cinder-quobyte-001cf61c-2e63-4556-9da4-742100e84c3d" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b7ce7-4a8e-4574-8a53-5e31ba7cbce5]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:25 devstack sudo[84788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d
Nov 14 03:19:25 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:26 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:26 devstack sudo[84793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d
Nov 14 03:19:26 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-bc2e9f71-1aaa-40b5-a392-1f2712d8287e req-71a4617f-d399-4ce9-9ad6-c33ffbf22f86 tempest-TaggedAttachmentsTest-1871709631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-bc2e9f71-1aaa-40b5-a392-1f2712d8287e req-71a4617f-d399-4ce9-9ad6-c33ffbf22f86 tempest-TaggedAttachmentsTest-1871709631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac74162-dbd4-47e7-99a9-665c88252a0e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-bc2e9f71-1aaa-40b5-a392-1f2712d8287e req-71a4617f-d399-4ce9-9ad6-c33ffbf22f86 tempest-TaggedAttachmentsTest-1871709631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:26 devstack sudo[84803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2
Nov 14 03:19:26 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:26 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-001cf61c-2e63-4556-9da4-742100e84c3d" returned: 0 in 0.522s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Lock "cinder-quobyte-001cf61c-2e63-4556-9da4-742100e84c3d" released by "delete_volume" :: held 1.103s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Created reservations ['99474be3-96a0-446b-9a07-2ae57d6d1cb0', '7e2e49bf-938c-4160-9674-300f91670a1b', 'b6f410b7-49b5-44f0-ab49-3f4c7d358865', '0bdf203e-510a-49e0-90c4-217fa1cac915'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:26 devstack sudo[84806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:26 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:26 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-bc2e9f71-1aaa-40b5-a392-1f2712d8287e req-71a4617f-d399-4ce9-9ad6-c33ffbf22f86 tempest-TaggedAttachmentsTest-1871709631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2" returned: 0 in 0.589s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-bc2e9f71-1aaa-40b5-a392-1f2712d8287e req-71a4617f-d399-4ce9-9ad6-c33ffbf22f86 tempest-TaggedAttachmentsTest-1871709631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.602s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-bc2e9f71-1aaa-40b5-a392-1f2712d8287e req-71a4617f-d399-4ce9-9ad6-c33ffbf22f86 tempest-TaggedAttachmentsTest-1871709631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-848c8a57-41d1-485e-89bb-4214980eb9c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26aa6625-bc4a-4606-add3-30b952820762', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:19:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-bc2e9f71-1aaa-40b5-a392-1f2712d8287e req-71a4617f-d399-4ce9-9ad6-c33ffbf22f86 tempest-TaggedAttachmentsTest-1871709631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-bc2e9f71-1aaa-40b5-a392-1f2712d8287e req-71a4617f-d399-4ce9-9ad6-c33ffbf22f86 tempest-TaggedAttachmentsTest-1871709631 None] attachment_update completed successfully.
Nov 14 03:19:27 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.487s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Deleted volume successfully.
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bc4f74e-9611-406b-93b7-aeccec0fe64c tempest-VolumesActionsTest-1565246839 None] Lock "cinder-001cf61c-2e63-4556-9da4-742100e84c3d-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (79874909-5e42-4023-aea8-91e4a3047f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266a949d-4119-46d2-b11d-21621b60157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266a949d-4119-46d2-b11d-21621b60157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578643436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4abbd4-28ac-461e-9459-d93397c44c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:28Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4f27a7-df65-4197-9f73-a1454842d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4f27a7-df65-4197-9f73-a1454842d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307009b2-73c8-4729-a5a0-8d3689534a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307009b2-73c8-4729-a5a0-8d3689534a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4abbd4-28ac-461e-9459-d93397c44c49', 'volume_name': 'volume-fd4abbd4-28ac-461e-9459-d93397c44c49', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6086d7-c114-479f-846f-a81591069e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6086d7-c114-479f-846f-a81591069e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b19052-2727-43e0-8743-df5692a4c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:27 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Volume fd4abbd4-28ac-461e-9459-d93397c44c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4abbd4-28ac-461e-9459-d93397c44c49', 'volume_size': 1}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578643436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4abbd4-28ac-461e-9459-d93397c44c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:28Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Creating volume fd4abbd4-28ac-461e-9459-d93397c44c49 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:19:27 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:19:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:27 devstack sudo[84879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49 1073741824
Nov 14 03:19:27 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:28 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49 1073741824" returned: 0 in 0.587s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:28 devstack sudo[85202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49
Nov 14 03:19:28 devstack sudo[85202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:29 devstack sudo[85202]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49" returned: 0 in 0.463s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:19:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b19052-2727-43e0-8743-df5692a4c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4abbd4-28ac-461e-9459-d93397c44c49', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0610cee-8482-4d59-9459-ab3d15ff00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:29 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Volume volume-fd4abbd4-28ac-461e-9459-d93397c44c49 (fd4abbd4-28ac-461e-9459-d93397c44c49): created successfully
Nov 14 03:19:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0610cee-8482-4d59-9459-ab3d15ff00d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (79874909-5e42-4023-aea8-91e4a3047f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7e7709d0-0635-46cd-ad69-ddcaa57914c1 tempest-VolumesActionsTest-181481048 None] Created volume successfully.
Nov 14 03:19:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-fd4abbd4-28ac-461e-9459-d93397c44c49-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Lock "cinder-fd4abbd4-28ac-461e-9459-d93397c44c49-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Acquiring lock "cinder-quobyte-fd4abbd4-28ac-461e-9459-d93397c44c49" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Lock "cinder-quobyte-fd4abbd4-28ac-461e-9459-d93397c44c49" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e725f4-19b9-46e2-88e2-6407706313c8]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:30 devstack sudo[85205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49
Nov 14 03:19:30 devstack sudo[85205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:30 devstack sudo[85205]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:30 devstack sudo[85211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49
Nov 14 03:19:30 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:31 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fd4abbd4-28ac-461e-9459-d93397c44c49" returned: 0 in 0.533s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Lock "cinder-quobyte-fd4abbd4-28ac-461e-9459-d93397c44c49" released by "delete_volume" :: held 1.116s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Created reservations ['17780cd2-bdec-4f64-8a24-4d4f87adbdb0', '4a857a0a-9a86-4fa4-9f21-449218b9143b', 'fe96511e-339f-47f4-8e59-cd8485489014', '6bf72cb7-7cac-4d96-8e82-60f791bf36ff'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:31 devstack sudo[85216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:31 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:31 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.466s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:31 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Deleted volume successfully.
Nov 14 03:19:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e7ead904-7c33-4cc0-ba26-b98200dc26ec tempest-VolumesActionsTest-1565246839 None] Lock "cinder-fd4abbd4-28ac-461e-9459-d93397c44c49-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:32 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (81b09cab-09a7-4eb0-8480-688250b938de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aefd668-5b4f-4ada-9e47-72f3f3369a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aefd668-5b4f-4ada-9e47-72f3f3369a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1995368327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392aca7c-6c60-47ff-9f89-69dff8fbcf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:33Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1c370f-88ca-4b7b-9330-5d8b142d56ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1c370f-88ca-4b7b-9330-5d8b142d56ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220a9c5d-8dd3-4f21-becc-1c4543d9abc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220a9c5d-8dd3-4f21-becc-1c4543d9abc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392aca7c-6c60-47ff-9f89-69dff8fbcf90', 'volume_name': 'volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9260fa95-17b2-479d-b086-92551a374e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9260fa95-17b2-479d-b086-92551a374e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd59eaba-e230-4729-84ac-ec2abe999a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:32 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Volume 392aca7c-6c60-47ff-9f89-69dff8fbcf90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90', 'volume_size': 1}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1995368327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392aca7c-6c60-47ff-9f89-69dff8fbcf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78015100cf2c48e2b69132c5971399b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:33Z,use_quota=True,user_id='6108f95d84994513be2a04a3f70f1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Creating volume 392aca7c-6c60-47ff-9f89-69dff8fbcf90 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:19:32 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:19:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:32 devstack sudo[85222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90 1073741824
Nov 14 03:19:32 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:33 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90 1073741824" returned: 0 in 0.539s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:33 devstack sudo[85227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90
Nov 14 03:19:33 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:33 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd59eaba-e230-4729-84ac-ec2abe999a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89acc5f-d68b-432c-9ad8-c5fff0f2e8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:33 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Volume volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90 (392aca7c-6c60-47ff-9f89-69dff8fbcf90): created successfully
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89acc5f-d68b-432c-9ad8-c5fff0f2e8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Flow 'volume_create_manager' (81b09cab-09a7-4eb0-8480-688250b938de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-70482597-c4ab-43ea-a8bb-685ab4496ce7 tempest-VolumesActionsTest-181481048 None] Created volume successfully.
Nov 14 03:19:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-0c396abf-d9bf-491e-9ac1-25ab8f5430ac req-0a1a4397-cd83-4b37-9147-15de0711468a tempest-TaggedAttachmentsTest-1871709631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-0c396abf-d9bf-491e-9ac1-25ab8f5430ac req-0a1a4397-cd83-4b37-9147-15de0711468a tempest-TaggedAttachmentsTest-1871709631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:34 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-0c396abf-d9bf-491e-9ac1-25ab8f5430ac req-0a1a4397-cd83-4b37-9147-15de0711468a tempest-TaggedAttachmentsTest-1871709631 None] Terminate volume connection completed successfully.
Nov 14 03:19:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-0c396abf-d9bf-491e-9ac1-25ab8f5430ac req-0a1a4397-cd83-4b37-9147-15de0711468a tempest-TaggedAttachmentsTest-1871709631 None] Deleting attachment 26aa6625-bc4a-4606-add3-30b952820762. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:19:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Acquiring lock "cinder-392aca7c-6c60-47ff-9f89-69dff8fbcf90-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Lock "cinder-392aca7c-6c60-47ff-9f89-69dff8fbcf90-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Acquiring lock "cinder-quobyte-392aca7c-6c60-47ff-9f89-69dff8fbcf90" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Lock "cinder-quobyte-392aca7c-6c60-47ff-9f89-69dff8fbcf90" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:35 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a3c04d-46dc-4e38-84d8-dc39b3590c01]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:35 devstack sudo[85257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90
Nov 14 03:19:35 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:35 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90" returned: 0 in 0.621s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:35 devstack sudo[85264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90
Nov 14 03:19:35 devstack sudo[85264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:36 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-7858bbc5-9829-420b-bc54-949ac691ec57 req-5878d50d-4d05-4fc2-b3a8-ed459f72a25b tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:36 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-7858bbc5-9829-420b-bc54-949ac691ec57 req-5878d50d-4d05-4fc2-b3a8-ed459f72a25b tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:36 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-7858bbc5-9829-420b-bc54-949ac691ec57 req-5878d50d-4d05-4fc2-b3a8-ed459f72a25b tempest-AttachVolumeTestJSON-1434321382 None] Terminate volume connection completed successfully.
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-7858bbc5-9829-420b-bc54-949ac691ec57 req-5878d50d-4d05-4fc2-b3a8-ed459f72a25b tempest-AttachVolumeTestJSON-1434321382 None] Deleting attachment 8531109f-0a79-4a55-b031-fef9eedd53a0. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:19:36 devstack sudo[85264]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-392aca7c-6c60-47ff-9f89-69dff8fbcf90" returned: 0 in 0.480s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Lock "cinder-quobyte-392aca7c-6c60-47ff-9f89-69dff8fbcf90" released by "delete_volume" :: held 1.132s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Created reservations ['b6cc3f2c-7b51-43a0-8a92-cd3ee6ead9bb', 'ccbd7388-2ff4-4512-bda3-91479b258fc1', '80e9581d-f5df-44e4-bfa8-533ff679c808', 'a4543324-6c8e-4165-b716-bffa31c4ef11'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:36 devstack sudo[85267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:36 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:37 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.476s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:37 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:37 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Deleted volume successfully.
Nov 14 03:19:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-feb9b9ab-85d1-4bb0-9bf9-c5cdc57889a6 tempest-VolumesActionsTest-181481048 None] Lock "cinder-392aca7c-6c60-47ff-9f89-69dff8fbcf90-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Acquiring lock "cinder-6f853efa-3e69-4c60-9a11-a219c4afdda4-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "cinder-6f853efa-3e69-4c60-9a11-a219c4afdda4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Acquiring lock "cinder-quobyte-6f853efa-3e69-4c60-9a11-a219c4afdda4" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "cinder-quobyte-6f853efa-3e69-4c60-9a11-a219c4afdda4" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:40 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd067ed5-a487-401c-8aa1-510bf181eb23]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:41 devstack sudo[85291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4
Nov 14 03:19:41 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:41 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4" returned: 0 in 0.686s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:41 devstack sudo[85298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4
Nov 14 03:19:41 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:42 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6f853efa-3e69-4c60-9a11-a219c4afdda4" returned: 0 in 0.510s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "cinder-quobyte-6f853efa-3e69-4c60-9a11-a219c4afdda4" released by "delete_volume" :: held 1.226s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Created reservations ['a50a6915-042d-4eba-8ee4-dd653f4d3980', '5d4ca007-1f92-4e88-ac74-5f1ce6a57bef', '566b9644-98f8-465c-9328-77f90325b803', '1718c82c-6f05-467d-96c5-e840ba65ab78'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:42 devstack sudo[85301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:42 devstack sudo[85301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:42 devstack sudo[85301]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.602s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:42 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Deleted volume successfully.
Nov 14 03:19:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4a898734-6227-47dc-9584-56245081969f tempest-VolumesAssistedSnapshotsTest-1275656139 None] Lock "cinder-6f853efa-3e69-4c60-9a11-a219c4afdda4-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Flow 'volume_create_manager' (8c757159-23f0-4608-9d42-d8b1927a701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0953cddf-2055-4dd9-afa4-8294febd8a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0953cddf-2055-4dd9-afa4-8294febd8a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1612344646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e83579-e4b9-47b6-82e7-41b6ce99466c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa4862c78084741bf6344d207d206fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:46Z,use_quota=True,user_id='6587dbb5290e4af9ad8bf33101fa04dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3e9833-f9ae-4392-8646-78e7f504b71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3e9833-f9ae-4392-8646-78e7f504b71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c5fd89-07bc-4f8a-b31e-fa83aea00226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c5fd89-07bc-4f8a-b31e-fa83aea00226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e83579-e4b9-47b6-82e7-41b6ce99466c', 'volume_name': 'volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc32bd9-2dad-4185-bac5-b381d24ef299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc32bd9-2dad-4185-bac5-b381d24ef299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8664a5f-84c9-482d-96f6-7ffdb0f0f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:45 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Volume b8e83579-e4b9-47b6-82e7-41b6ce99466c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c', 'volume_size': 1}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1612344646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e83579-e4b9-47b6-82e7-41b6ce99466c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa4862c78084741bf6344d207d206fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:19:46Z,use_quota=True,user_id='6587dbb5290e4af9ad8bf33101fa04dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Creating volume b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:19:45 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:19:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:45 devstack sudo[85348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c 1073741824
Nov 14 03:19:45 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:46 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c 1073741824" returned: 0 in 0.927s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:46 devstack sudo[85388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c
Nov 14 03:19:46 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:47 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:19:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8664a5f-84c9-482d-96f6-7ffdb0f0f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3203cb-6d95-48c0-87d4-3de56e8336a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:19:47 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Volume volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c (b8e83579-e4b9-47b6-82e7-41b6ce99466c): created successfully
Nov 14 03:19:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3203cb-6d95-48c0-87d4-3de56e8336a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:19:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Flow 'volume_create_manager' (8c757159-23f0-4608-9d42-d8b1927a701e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:19:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f44e7d8b-d26a-42a2-9b4f-c57abe64f6ae tempest-VolumesDeleteCascade-1014812023 None] Created volume successfully.
Nov 14 03:19:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Creating offline snapshot 4728f8ac-0947-41a6-9425-7d8366670eba of volume b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:19:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[89312c23-3d0a-4d03-963e-4045236abe23]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:48 devstack sudo[85393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c
Nov 14 03:19:48 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:48 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c" returned: 0 in 0.649s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:48 devstack sudo[85400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba 1G
Nov 14 03:19:48 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:49 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba 1G" returned: 0 in 0.613s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:49 devstack sudo[85406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba
Nov 14 03:19:49 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:49 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:49 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba is being set with open permissions: ugo+rw
Nov 14 03:19:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:50 devstack sudo[85411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba
Nov 14 03:19:50 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:50 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba" returned: 0 in 0.578s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:50 devstack sudo[85415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.info
Nov 14 03:19:50 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:51 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.info" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:51 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.info is being set with open permissions: ugo+rw
Nov 14 03:19:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:51 devstack sudo[85418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.info
Nov 14 03:19:51 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:51 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.info" returned: 0 in 0.565s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.550s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:51 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=76,cinder:SELECT=65,cinder:DELETE=5,cinder:INSERT=13 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:19:51 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=52,cinder:UPDATE=76,cinder:INSERT=17,cinder:DELETE=9 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:19:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e248e568-15a0-4ad6-baf1-dd22e1ca4fb3 tempest-VolumesDeleteCascade-1014812023 None] Create snapshot completed successfully
Nov 14 03:19:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Creating offline snapshot 6f2d0005-1cee-4992-8a7a-600549a38c14 of volume b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf6b1a5-3581-403d-9742-fdb87161536c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:52 devstack sudo[85423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba
Nov 14 03:19:52 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Acquiring lock "cinder-848c8a57-41d1-485e-89bb-4214980eb9c2-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Lock "cinder-848c8a57-41d1-485e-89bb-4214980eb9c2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Acquiring lock "cinder-quobyte-848c8a57-41d1-485e-89bb-4214980eb9c2" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Lock "cinder-quobyte-848c8a57-41d1-485e-89bb-4214980eb9c2" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50d16c4-0c54-47c8-a1cd-ae5f5cc2b7ee]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:52 devstack sudo[85425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2
Nov 14 03:19:52 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:53 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba" returned: 0 in 0.869s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:19:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:53 devstack sudo[85430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 1G
Nov 14 03:19:53 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:53 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2" returned: 0 in 0.742s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:53 devstack sudo[85435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2
Nov 14 03:19:53 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:54 devstack sudo[85442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:54 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:54 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-848c8a57-41d1-485e-89bb-4214980eb9c2" returned: 0 in 0.620s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Lock "cinder-quobyte-848c8a57-41d1-485e-89bb-4214980eb9c2" released by "delete_volume" :: held 1.385s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:54 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 1G" returned: 0 in 0.795s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:54 devstack sudo[85444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14
Nov 14 03:19:54 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Created reservations ['102af7d6-c3c7-4928-8086-6a3657627d58', '6c2927cf-3f1b-44b0-b1b2-bbd8c9ccb056', '9ea1f0fa-fa9a-4719-bc38-250b9206326a', '3ceb8d20-9cd7-4a0c-a534-84fe9bceaf5b'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:54 devstack sudo[85446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:19:54 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:54 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:54 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.565s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:19:54 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Deleted volume successfully.
Nov 14 03:19:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-30a2ba07-acc0-4ecd-b431-8a5851f43873 tempest-TaggedAttachmentsTest-1871709631 None] Lock "cinder-848c8a57-41d1-485e-89bb-4214980eb9c2-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:19:55 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14" returned: 0 in 0.904s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:55 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 is being set with open permissions: ugo+rw
Nov 14 03:19:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:55 devstack sudo[85454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14
Nov 14 03:19:55 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:55 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.197s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:19:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a7126326-e8ab-45e9-9933-347b0c7e8c67 tempest-VolumesDeleteCascade-1014812023 None] Create snapshot completed successfully
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-b8e83579-e4b9-47b6-82e7-41b6ce99466c-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-b8e83579-e4b9-47b6-82e7-41b6ce99466c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Performing cascade delete. {{(pid=80846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-4728f8ac-0947-41a6-9425-7d8366670eba-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-4728f8ac-0947-41a6-9425-7d8366670eba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-4728f8ac-0947-41a6-9425-7d8366670eba" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-4728f8ac-0947-41a6-9425-7d8366670eba" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Deleting offline snapshot 4728f8ac-0947-41a6-9425-7d8366670eba of volume b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] snapshot_file for this snap is: volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[57504f37-e864-4fda-8bfd-b869f9ffb4eb]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:56 devstack sudo[85474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba
Nov 14 03:19:56 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:57 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba" returned: 0 in 0.677s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:19:57 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5493dd-73e7-4631-90a0-c4fbdbd13a58]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:57 devstack sudo[85480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c
Nov 14 03:19:57 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:58 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c" returned: 0 in 0.663s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:58 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[796c55cf-69ec-4596-bc13-4652a27c7e24]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:58 devstack sudo[85486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14
Nov 14 03:19:58 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:58 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14" returned: 0 in 0.732s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:19:58 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8743f7-c1f0-4cf7-a41d-0c4cd153f9ca]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:59 devstack sudo[85492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba
Nov 14 03:19:59 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:19:59 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root
Nov 14 03:19:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba" returned: 0 in 0.661s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:19:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:19:59 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[50278c0c-c71e-4356-b0b3-46ff4a73c4fd]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:19:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:19:59 devstack sudo[85498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c
Nov 14 03:19:59 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:00 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c" returned: 0 in 0.809s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:00 devstack sudo[85505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba
Nov 14 03:20:00 devstack sudo[85505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:01 devstack sudo[85505]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba" returned: 0 in 0.648s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:01 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba
Nov 14 03:20:01 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:01 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.4728f8ac-0947-41a6-9425-7d8366670eba" returned: 0 in 0.622s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 -F qcow2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:01 devstack sudo[85515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 -F qcow2
Nov 14 03:20:01 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:02 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 -F qcow2" returned: 0 in 0.665s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-4728f8ac-0947-41a6-9425-7d8366670eba" released by "_delete_snapshot" :: held 5.601s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" released by "delete_snapshot" :: held 5.616s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:02 devstack cinder-volume[80846]: WARNING cinder.quota [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Created reservations ['b8d21cbc-36f1-4816-b482-f6bcc5e0007a', 'a67d30e2-317e-48e0-9ee4-5653fe8ed465', 'd77965fd-2919-4c30-9220-ea9ee27957d2', 'f8f12830-398e-44ce-9613-872c39035f55'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:20:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Delete snapshot completed successfully.
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-4728f8ac-0947-41a6-9425-7d8366670eba-delete_snapshot" released by "delete_snapshot" :: held 5.787s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-6f2d0005-1cee-4992-8a7a-600549a38c14-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-6f2d0005-1cee-4992-8a7a-600549a38c14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-6f2d0005-1cee-4992-8a7a-600549a38c14" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-6f2d0005-1cee-4992-8a7a-600549a38c14" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Deleting offline snapshot 6f2d0005-1cee-4992-8a7a-600549a38c14 of volume b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] snapshot_file for this snap is: volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a37cb5f-b456-4c56-a769-89c36f89f1f4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:02 devstack sudo[85523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14
Nov 14 03:20:02 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:03 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14" returned: 0 in 0.766s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:20:03 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[db294850-4cf1-4745-8405-ad935308409e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:03 devstack sudo[85529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c
Nov 14 03:20:03 devstack sudo[85529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:04 devstack sudo[85529]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c" returned: 0 in 1.059s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:04 devstack sudo[85586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14
Nov 14 03:20:04 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:05 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14" returned: 0 in 0.920s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:05 devstack sudo[85598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14
Nov 14 03:20:05 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:06 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c.6f2d0005-1cee-4992-8a7a-600549a38c14" returned: 0 in 0.796s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-6f2d0005-1cee-4992-8a7a-600549a38c14" released by "_delete_snapshot" :: held 3.614s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" released by "delete_snapshot" :: held 3.640s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Created reservations ['475cc791-5949-4200-9713-6349b5096027', '3221c726-b740-449f-af49-99c30ced6c6e', 'b7735b3b-ed27-4f06-91f1-90df3905819d', '41849ab3-f863-482d-a841-3a7cb4ecca44'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:20:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Delete snapshot completed successfully.
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-6f2d0005-1cee-4992-8a7a-600549a38c14-delete_snapshot" released by "delete_snapshot" :: held 3.774s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Snapshots deleted, issuing volume delete {{(pid=80846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[61472b31-439e-4527-b8c7-6c3d710e09f9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:06 devstack sudo[85601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c
Nov 14 03:20:06 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:07 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c" returned: 0 in 0.704s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:07 devstack sudo[85606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c
Nov 14 03:20:07 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:07 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b8e83579-e4b9-47b6-82e7-41b6ce99466c" returned: 0 in 0.475s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-b8e83579-e4b9-47b6-82e7-41b6ce99466c" released by "delete_volume" :: held 1.217s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Created reservations ['9d1d4187-735e-4715-8b6e-55c52c172ae2', '997ca842-c8b8-40cf-9dac-ca9055f83e32', '3462a362-e6b3-4c68-a6e0-9b2a0ff362a1', 'dc05018e-c951-426c-834e-6e91bf1001ae'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:07 devstack sudo[85609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:20:07 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:08 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Flow 'volume_create_manager' (92b20df3-8b87-44ad-bfdc-851d471d38c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54001c5b-7295-47ef-bddc-4e3937a5e9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54001c5b-7295-47ef-bddc-4e3937a5e9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-150903259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67292218-e9ac-4ff0-a098-76925e527085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa4862c78084741bf6344d207d206fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:08Z,use_quota=True,user_id='6587dbb5290e4af9ad8bf33101fa04dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc8335f-6ee6-42c2-958e-79e0ede0fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc8335f-6ee6-42c2-958e-79e0ede0fca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1351f208-93ec-4cca-9ad5-dfcf01733b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:08 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1351f208-93ec-4cca-9ad5-dfcf01733b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67292218-e9ac-4ff0-a098-76925e527085', 'volume_name': 'volume-67292218-e9ac-4ff0-a098-76925e527085', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5998dce2-3b5b-4277-af9e-c5c8cb060ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5998dce2-3b5b-4277-af9e-c5c8cb060ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ad0529-731a-401d-9fd6-189054de73fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:08 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Volume 67292218-e9ac-4ff0-a098-76925e527085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67292218-e9ac-4ff0-a098-76925e527085', 'volume_size': 1}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-150903259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67292218-e9ac-4ff0-a098-76925e527085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa4862c78084741bf6344d207d206fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:08Z,use_quota=True,user_id='6587dbb5290e4af9ad8bf33101fa04dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Creating volume 67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:08 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.892s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:20:08 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Deleted volume successfully.
Nov 14 03:20:08 devstack sudo[85612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 1073741824
Nov 14 03:20:08 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cfd07d61-f56e-44ce-bf56-8e5ae1b14f7f tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-b8e83579-e4b9-47b6-82e7-41b6ce99466c-delete_volume" released by "delete_volume" :: held 11.930s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:09 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 1073741824" returned: 0 in 0.876s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:09 devstack sudo[85617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085
Nov 14 03:20:09 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:10 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085" returned: 0 in 0.943s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ad0529-731a-401d-9fd6-189054de73fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67292218-e9ac-4ff0-a098-76925e527085', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70429cd2-640c-4f78-b240-743fd370b0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:10 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Volume volume-67292218-e9ac-4ff0-a098-76925e527085 (67292218-e9ac-4ff0-a098-76925e527085): created successfully
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70429cd2-640c-4f78-b240-743fd370b0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Flow 'volume_create_manager' (92b20df3-8b87-44ad-bfdc-851d471d38c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5abe6fbf-9058-4861-b0be-c8535972e5c7 tempest-VolumesDeleteCascade-1014812023 None] Created volume successfully.
Nov 14 03:20:10 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Creating offline snapshot 0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 of volume 67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc4442b-2d82-41b5-a612-e67b91649796]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:11 devstack sudo[85621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085
Nov 14 03:20:11 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:11 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085" returned: 0 in 0.900s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:11 devstack sudo[85626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 1G
Nov 14 03:20:11 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:12 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 1G" returned: 0 in 0.952s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67292218-e9ac-4ff0-a098-76925e527085 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:12 devstack sudo[85631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67292218-e9ac-4ff0-a098-76925e527085 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390
Nov 14 03:20:12 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:13 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67292218-e9ac-4ff0-a098-76925e527085 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" returned: 0 in 1.036s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:13 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 is being set with open permissions: ugo+rw
Nov 14 03:20:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:13 devstack sudo[85636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390
Nov 14 03:20:13 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:14 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" returned: 0 in 0.724s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:14 devstack sudo[85639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.info
Nov 14 03:20:14 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:15 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.info" returned: 0 in 0.696s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:15 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.info is being set with open permissions: ugo+rw
Nov 14 03:20:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:15 devstack sudo[85642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.info
Nov 14 03:20:15 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:15 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.info" returned: 0 in 0.572s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.953s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:15 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ff1e4544-d871-4a4b-9a1f-3f5f6c5e2e53 tempest-VolumesDeleteCascade-1014812023 None] Create snapshot completed successfully
Nov 14 03:20:16 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Flow 'volume_create_manager' (6a257514-15c0-4b0f-b63f-76136a99de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23b66de-7102-4e93-8fc3-4cab0b45ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23b66de-7102-4e93-8fc3-4cab0b45ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-652073681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa4862c78084741bf6344d207d206fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d1142a7-47e8-4a5f-9a21-b5e4bdd24390,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:17Z,use_quota=True,user_id='6587dbb5290e4af9ad8bf33101fa04dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfce63ec-176a-4ce2-9d93-4a1ada50f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfce63ec-176a-4ce2-9d93-4a1ada50f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e61369-4e55-4575-94b3-51e32b46ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e61369-4e55-4575-94b3-51e32b46ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd', 'volume_name': 'volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd', 'volume_size': 1, 'snapshot_id': '0d1142a7-47e8-4a5f-9a21-b5e4bdd24390'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f4141d-4607-4d53-93e9-b21ec3a3951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f4141d-4607-4d53-93e9-b21ec3a3951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136827c8-769c-4c24-be8c-d27955758589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:16 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Volume fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd', 'volume_size': 1, 'snapshot_id': '0d1142a7-47e8-4a5f-9a21-b5e4bdd24390'}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Creating volume fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd from snapshot 0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] snapshot: 0d1142a7-47e8-4a5f-9a21-b5e4bdd24390, volume: fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a761792-df74-4e60-a0d8-85b4722eead9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:17 devstack sudo[85646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390
Nov 14 03:20:17 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:17 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" returned: 0 in 1.017s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67292218-e9ac-4ff0-a098-76925e527085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:20:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:20:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:20:17 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ae38db-38ec-4c33-b6f8-39e2e2651640]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:18 devstack sudo[85685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085
Nov 14 03:20:18 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:18 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085" returned: 0 in 0.852s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:18 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:20:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:18 devstack sudo[85691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd
Nov 14 03:20:18 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:21 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" returned: 0 in 3.196s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b4d04a-4d6d-46b2-a0c0-4abf87e1a772]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:22 devstack sudo[85722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085
Nov 14 03:20:22 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:22 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085" returned: 0 in 0.853s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:22 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085, size 1024.00 MB, duration 3.20 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:20:22 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Converted 1024.00 MB image at 320.15 MB/s
Nov 14 03:20:22 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd is being set with open permissions: ugo+rw
Nov 14 03:20:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:22 devstack sudo[85727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd
Nov 14 03:20:22 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:23 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" returned: 0 in 0.664s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" released by "_copy_volume_from_snapshot" :: held 6.677s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" released by "_create_volume_from_snapshot" :: held 6.703s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.723s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136827c8-769c-4c24-be8c-d27955758589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd', 'volume_size': 1, 'snapshot_id': '0d1142a7-47e8-4a5f-9a21-b5e4bdd24390'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb4f44b-d5c6-45da-b54f-0cd2c706d588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:23 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Volume volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd (fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd): created successfully
Nov 14 03:20:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb4f44b-d5c6-45da-b54f-0cd2c706d588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Flow 'volume_create_manager' (6a257514-15c0-4b0f-b63f-76136a99de96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0dc5bf3c-42ce-4176-a2e9-a3aa4da503f8 tempest-VolumesDeleteCascade-1014812023 None] Created volume successfully.
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-67292218-e9ac-4ff0-a098-76925e527085-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-67292218-e9ac-4ff0-a098-76925e527085-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Performing cascade delete. {{(pid=80846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-67292218-e9ac-4ff0-a098-76925e527085" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-67292218-e9ac-4ff0-a098-76925e527085" acquired by "delete_snapshot" :: waited 0.021s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Deleting offline snapshot 0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 of volume 67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] snapshot_file for this snap is: volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f48a48-d800-45df-bc25-a6858f69cbb3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:24 devstack sudo[85730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390
Nov 14 03:20:24 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:25 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" returned: 0 in 0.828s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67292218-e9ac-4ff0-a098-76925e527085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:20:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e572d43f-6f85-4fb0-b006-b9aca2c25099]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:25 devstack sudo[85747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085
Nov 14 03:20:25 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:26 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085" returned: 0 in 1.029s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:26 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390
Nov 14 03:20:26 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:27 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" returned: 0 in 0.711s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:27 devstack sudo[85772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390
Nov 14 03:20:27 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:28 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085.0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" returned: 0 in 0.820s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390" released by "_delete_snapshot" :: held 3.550s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-67292218-e9ac-4ff0-a098-76925e527085" released by "delete_snapshot" :: held 3.571s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Created reservations ['0e48a210-ed83-4cbe-9a9f-fef5115286bc', '0830bbe0-9d7b-4c75-a71e-01ae5d08defe', '46240030-e412-4be0-b9bc-4ea8f55fe47f', 'db0f38ea-e006-46f8-b655-fc777293bb88'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:20:28 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Delete snapshot completed successfully.
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-0d1142a7-47e8-4a5f-9a21-b5e4bdd24390-delete_snapshot" released by "delete_snapshot" :: held 3.708s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Snapshots deleted, issuing volume delete {{(pid=80846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-67292218-e9ac-4ff0-a098-76925e527085" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-67292218-e9ac-4ff0-a098-76925e527085" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62ab2e3-4055-45a3-9e31-95a0130e5d7b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:28 devstack sudo[85775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085
Nov 14 03:20:28 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:29 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Flow 'volume_create_manager' (9b817f13-2067-4b3a-becd-590c3957b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e57b5d-69c7-4a64-95ad-eb744862c9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e57b5d-69c7-4a64-95ad-eb744862c9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-665667707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5424b32d-b747-4f02-bbb1-29f080aea40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5c73ff0ec34e51bc8b6ceb88249f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:29Z,use_quota=True,user_id='1a52ca839cd144ed920562c899de8fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194b3ce4-3c8f-4ddc-835e-1319af1a7944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194b3ce4-3c8f-4ddc-835e-1319af1a7944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb2cb1e-79a4-4f3a-8a81-090efad8b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:29 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085" returned: 0 in 0.946s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:29 devstack sudo[85780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085
Nov 14 03:20:29 devstack sudo[85780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb2cb1e-79a4-4f3a-8a81-090efad8b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5424b32d-b747-4f02-bbb1-29f080aea40b', 'volume_name': 'volume-5424b32d-b747-4f02-bbb1-29f080aea40b', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26ed7dc0>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26d1613-7bfc-47a1-b59d-dbcd7958481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26d1613-7bfc-47a1-b59d-dbcd7958481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5288719-2e61-4f34-a2c8-12ac801a5a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:29 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume 5424b32d-b747-4f02-bbb1-29f080aea40b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5424b32d-b747-4f02-bbb1-29f080aea40b', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26ed7dc0>}
Nov 14 03:20:29 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Cloning 5424b32d-b747-4f02-bbb1-29f080aea40b from image 505e4538-4930-46f5-ae28-a520ed743bcf  at location (None, None). {{(pid=80846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:20:30 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Image download 20.69 MB at 20.69 MB/s
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5ba89-90db-4830-b783-cce192b30f9d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:30 devstack sudo[85780]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-67292218-e9ac-4ff0-a098-76925e527085" returned: 0 in 0.745s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-67292218-e9ac-4ff0-a098-76925e527085" released by "delete_volume" :: held 1.767s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Created reservations ['a00c1ed2-a83f-4432-9339-af88f793b7a8', '5badb80b-9324-438a-8b90-578e0d664c7b', '90148313-2feb-4a9f-ab46-9e4db3d0b7f4', 'fc633404-d949-4ae9-9363-70a45bb7c57f'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:20:30 devstack sudo[85803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD
Nov 14 03:20:30 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:30 devstack sudo[85805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:20:30 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:30 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf is fetched for user 1a52ca839cd144ed920562c899de8fdf. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27bdf2-86a6-4230-83ea-caef5f68fb52]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:31 devstack sudo[85811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD
Nov 14 03:20:31 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:31 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.782s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:20:31 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Deleted volume successfully.
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9936201f-0d02-4df3-96f6-c116ae785553 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-67292218-e9ac-4ff0-a098-76925e527085-delete_volume" released by "delete_volume" :: held 6.506s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:31 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "cinder-quobyte-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[637f8d45-df83-437e-9fb9-b74ca2fd6423]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:31 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-665667707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5424b32d-b747-4f02-bbb1-29f080aea40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5c73ff0ec34e51bc8b6ceb88249f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:29Z,use_quota=True,user_id='1a52ca839cd144ed920562c899de8fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Creating volume 5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:31 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:20:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:31 devstack sudo[85818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b 1073741824
Nov 14 03:20:31 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:31 devstack sudo[85817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd
Nov 14 03:20:31 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:32 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" returned: 0 in 0.948s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:32 devstack sudo[85827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd
Nov 14 03:20:32 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:32 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b 1073741824" returned: 0 in 0.939s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:32 devstack sudo[85829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:20:32 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:33 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" returned: 0 in 0.500s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-quobyte-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd" released by "delete_volume" :: held 1.536s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Created reservations ['6c36d20d-1772-4fe8-8e0a-8b385f01c083', '468605c8-9b3c-4b1c-a52f-840b68c1c388', 'd06893a7-f3cd-4850-8d04-c218fd45b65c', 'b0b85bb2-018a-4bf8-909b-c3081999689b'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:33 devstack sudo[85833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:20:33 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:33 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 0 in 0.593s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Attempting download of 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 5424b32d-b747-4f02-bbb1-29f080aea40b. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[80276df3-e3ce-4327-8175-2c1a2c8f82ce]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_s3uk76sj {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:33 devstack sudo[85835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_s3uk76sj
Nov 14 03:20:33 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:33 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.654s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:20:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Deleted volume successfully.
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4b3978e8-9739-48ee-a719-b1433bed0e87 tempest-VolumesDeleteCascade-1014812023 None] Lock "cinder-fbabdaf8-f05f-448e-b0ab-f7e20ccc0fcd-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:33 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_s3uk76sj" returned: 0 in 0.728s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_s3uk76sj {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:34 devstack sudo[85840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_s3uk76sj
Nov 14 03:20:34 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:34 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_s3uk76sj" returned: 1 in 0.667s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_s3uk76sj' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:20:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c07e04-43a0-42cc-b9c3-094714dc58f7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:34 devstack sudo[85844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD
Nov 14 03:20:34 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:35 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:35 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] 505e4538-4930-46f5-ae28-a520ed743bcf was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:20:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:35 devstack sudo[85849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:20:35 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:37 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 0 in 1.563s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_jh26uircdevstack@QuobyteHD, size 112.00 MB, duration 1.56 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:20:37 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Converted 112.00 MB image at 71.58 MB/s
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:37 devstack sudo[85862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b 1G
Nov 14 03:20:37 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:37 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Flow 'volume_create_manager' (79d2bc5e-1db5-402d-ab68-db08b09877db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d05a624-8fc7-4559-acb4-d0449d794c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d05a624-8fc7-4559-acb4-d0449d794c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-65196203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802e4df5-39aa-4a0b-aafe-e244912df634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5464cb060c1426f9ad7e68630055c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:38Z,use_quota=True,user_id='e4fcbf8d7f1c42adb47058b2046b2fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edef6cc5-7545-43d9-b124-a5bf06a7b4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edef6cc5-7545-43d9-b124-a5bf06a7b4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167c3b1a-2428-4613-bae5-59f6b7e6c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167c3b1a-2428-4613-bae5-59f6b7e6c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802e4df5-39aa-4a0b-aafe-e244912df634', 'volume_name': 'volume-802e4df5-39aa-4a0b-aafe-e244912df634', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b290ecb-83ac-4253-a2d8-3161137fe29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b290ecb-83ac-4253-a2d8-3161137fe29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198c861a-babb-4355-bfaf-ddecb01642aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:37 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Volume 802e4df5-39aa-4a0b-aafe-e244912df634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802e4df5-39aa-4a0b-aafe-e244912df634', 'volume_size': 1}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-65196203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802e4df5-39aa-4a0b-aafe-e244912df634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5464cb060c1426f9ad7e68630055c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:38Z,use_quota=True,user_id='e4fcbf8d7f1c42adb47058b2046b2fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Creating volume 802e4df5-39aa-4a0b-aafe-e244912df634 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:37 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:37 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b 1G" returned: 0 in 0.621s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:37 devstack sudo[85867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634 1073741824
Nov 14 03:20:37 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45ca020-18db-4e92-8c08-c2013e55a873]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:37 devstack sudo[85869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:20:37 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:38 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634 1073741824" returned: 0 in 0.693s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:38 devstack sudo[85876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634
Nov 14 03:20:38 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:38 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 0 in 0.693s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:38 devstack sudo[85878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:20:38 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:38 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198c861a-babb-4355-bfaf-ddecb01642aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802e4df5-39aa-4a0b-aafe-e244912df634', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58440da4-9636-4abb-8d88-bebd3c21b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:38 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Volume volume-802e4df5-39aa-4a0b-aafe-e244912df634 (802e4df5-39aa-4a0b-aafe-e244912df634): created successfully
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58440da4-9636-4abb-8d88-bebd3c21b28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Flow 'volume_create_manager' (79d2bc5e-1db5-402d-ab68-db08b09877db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:38 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f4a8925f-7c2b-4566-ad77-2ad33b427fcd tempest-VolumesTransfersV357Test-1799321952 None] Created volume successfully.
Nov 14 03:20:39 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 1 in 0.771s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Downloaded image 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 5424b32d-b747-4f02-bbb1-29f080aea40b successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf for user 1a52ca839cd144ed920562c899de8fdf is deleted. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Marking volume 5424b32d-b747-4f02-bbb1-29f080aea40b as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Copying metadata from image 505e4538-4930-46f5-ae28-a520ed743bcf to 5424b32d-b747-4f02-bbb1-29f080aea40b. {{(pid=80846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Creating volume glance metadata for volume 5424b32d-b747-4f02-bbb1-29f080aea40b backed by image 505e4538-4930-46f5-ae28-a520ed743bcf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5288719-2e61-4f34-a2c8-12ac801a5a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5424b32d-b747-4f02-bbb1-29f080aea40b', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26ed7dc0>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf48e6ec-3294-40a2-b4f7-e65af9b29c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:39 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume volume-5424b32d-b747-4f02-bbb1-29f080aea40b (5424b32d-b747-4f02-bbb1-29f080aea40b): created successfully
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf48e6ec-3294-40a2-b4f7-e65af9b29c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Flow 'volume_create_manager' (9b817f13-2067-4b3a-becd-590c3957b983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:39 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6d50913d-8d56-4b51-9cc5-9f46972ec8a7 tempest-TaggedBootDevicesTest_v242-354891865 None] Created volume successfully.
Nov 14 03:20:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7803a88d-17ac-4848-be83-f98572a5f36f tempest-VolumesTransfersV357Test-1645293347 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:40 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7803a88d-17ac-4848-be83-f98572a5f36f tempest-VolumesTransfersV357Test-1645293347 None] Transfer volume completed successfully.
Nov 14 03:20:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Flow 'volume_create_manager' (ed3d12d7-6ac9-4724-98d4-8f38129fa461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4b627c-01fd-463e-b855-246e9de22eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4b627c-01fd-463e-b855-246e9de22eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-13637743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4716f97-dec5-4742-b178-d3f6e9699f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5c73ff0ec34e51bc8b6ceb88249f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:40Z,use_quota=True,user_id='1a52ca839cd144ed920562c899de8fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4c09b3-9d93-4646-aef5-0f9a2ce0d0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4c09b3-9d93-4646-aef5-0f9a2ce0d0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4afd0d3-1d25-46ed-ba0f-6a3b0b49efd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4afd0d3-1d25-46ed-ba0f-6a3b0b49efd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4716f97-dec5-4742-b178-d3f6e9699f53', 'volume_name': 'volume-c4716f97-dec5-4742-b178-d3f6e9699f53', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8433b3fc-1fe5-43ad-b65d-6c0a38335a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8433b3fc-1fe5-43ad-b65d-6c0a38335a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5928eb-2037-4b1f-836b-cf7999f379ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:40 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Volume c4716f97-dec5-4742-b178-d3f6e9699f53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4716f97-dec5-4742-b178-d3f6e9699f53', 'volume_size': 1}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-13637743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4716f97-dec5-4742-b178-d3f6e9699f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5c73ff0ec34e51bc8b6ceb88249f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:40Z,use_quota=True,user_id='1a52ca839cd144ed920562c899de8fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Creating volume c4716f97-dec5-4742-b178-d3f6e9699f53 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:40 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:40 devstack sudo[85886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53 1073741824
Nov 14 03:20:40 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Acquiring lock "cinder-802e4df5-39aa-4a0b-aafe-e244912df634-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Lock "cinder-802e4df5-39aa-4a0b-aafe-e244912df634-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Acquiring lock "cinder-quobyte-802e4df5-39aa-4a0b-aafe-e244912df634" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Lock "cinder-quobyte-802e4df5-39aa-4a0b-aafe-e244912df634" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9acdd3-46f8-4829-b205-81073efd3de8]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:41 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53 1073741824" returned: 0 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:41 devstack sudo[85892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53
Nov 14 03:20:41 devstack sudo[85892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:41 devstack sudo[85891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634
Nov 14 03:20:41 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:41 devstack sudo[85892]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53" returned: 0 in 0.478s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5928eb-2037-4b1f-836b-cf7999f379ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4716f97-dec5-4742-b178-d3f6e9699f53', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3629616e-a916-4e91-b45d-b958399a142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Volume volume-c4716f97-dec5-4742-b178-d3f6e9699f53 (c4716f97-dec5-4742-b178-d3f6e9699f53): created successfully
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3629616e-a916-4e91-b45d-b958399a142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Flow 'volume_create_manager' (ed3d12d7-6ac9-4724-98d4-8f38129fa461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-50077ebd-5244-4010-9a78-55715fa3445f tempest-TaggedBootDevicesTest_v242-354891865 None] Created volume successfully.
Nov 14 03:20:41 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634" returned: 0 in 0.620s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:41 devstack sudo[85899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634
Nov 14 03:20:41 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:42 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-802e4df5-39aa-4a0b-aafe-e244912df634" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Lock "cinder-quobyte-802e4df5-39aa-4a0b-aafe-e244912df634" released by "delete_volume" :: held 1.128s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Created reservations ['de8d033e-83f0-4a05-bb11-f2613e83118f', '055b6542-2f55-4f2c-acc1-b7c12b11b924', 'aec03315-20b0-4ec5-8cd8-a61316c51332', '8221a291-2015-4821-b134-2ca6465541f7'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:42 devstack sudo[85903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:20:42 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:42 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Flow 'volume_create_manager' (3ac9dacb-e094-44d3-b3cf-904cf2cada5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142a7db0-59e1-41d4-8239-6679ef0e886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142a7db0-59e1-41d4-8239-6679ef0e886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-899261408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0928274a-ec39-4300-a210-81a14cab8a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5c73ff0ec34e51bc8b6ceb88249f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:43Z,use_quota=True,user_id='1a52ca839cd144ed920562c899de8fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757947a5-87e9-461d-9b4b-25b82bde3017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757947a5-87e9-461d-9b4b-25b82bde3017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a6169-f29c-447e-9384-836955e8e7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a6169-f29c-447e-9384-836955e8e7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0928274a-ec39-4300-a210-81a14cab8a89', 'volume_name': 'volume-0928274a-ec39-4300-a210-81a14cab8a89', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7302369d-df45-4058-b7e0-c373bef7c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7302369d-df45-4058-b7e0-c373bef7c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b3f767-57aa-4334-8936-906201c8a492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:42 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume 0928274a-ec39-4300-a210-81a14cab8a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0928274a-ec39-4300-a210-81a14cab8a89', 'volume_size': 1}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-899261408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0928274a-ec39-4300-a210-81a14cab8a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5c73ff0ec34e51bc8b6ceb88249f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:43Z,use_quota=True,user_id='1a52ca839cd144ed920562c899de8fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Creating volume 0928274a-ec39-4300-a210-81a14cab8a89 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:20:42 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:42 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.608s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:20:42 devstack sudo[85906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89 1073741824
Nov 14 03:20:42 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:42 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Deleted volume successfully.
Nov 14 03:20:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1f55f88c-fe66-4f43-87cf-031e8e074929 tempest-VolumesTransfersV357Test-2090067159 None] Lock "cinder-802e4df5-39aa-4a0b-aafe-e244912df634-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Flow 'volume_create_manager' (31b3c692-b5c9-41e6-9fff-2793ed0300df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce300a0-01d3-45c3-9f4f-4bc5fdb493f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce300a0-01d3-45c3-9f4f-4bc5fdb493f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-823475881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd2d312-46cb-4f8e-9704-5f2123180677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5464cb060c1426f9ad7e68630055c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:43Z,use_quota=True,user_id='e4fcbf8d7f1c42adb47058b2046b2fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934f398a-bd5e-4535-bed5-26a29bab4c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934f398a-bd5e-4535-bed5-26a29bab4c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7a576d-3793-4508-b847-1807a116442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7a576d-3793-4508-b847-1807a116442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd2d312-46cb-4f8e-9704-5f2123180677', 'volume_name': 'volume-4cd2d312-46cb-4f8e-9704-5f2123180677', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ea8726-ce73-43c5-a6cf-5bab861f0510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ea8726-ce73-43c5-a6cf-5bab861f0510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2b3634-88d5-4e9d-8b0b-f7b38c248f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:43 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Volume 4cd2d312-46cb-4f8e-9704-5f2123180677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd2d312-46cb-4f8e-9704-5f2123180677', 'volume_size': 1}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:43 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89 1073741824" returned: 0 in 0.926s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:43 devstack sudo[85913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89
Nov 14 03:20:43 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:44 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89" returned: 0 in 0.586s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-823475881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd2d312-46cb-4f8e-9704-5f2123180677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5464cb060c1426f9ad7e68630055c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:43Z,use_quota=True,user_id='e4fcbf8d7f1c42adb47058b2046b2fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Creating volume 4cd2d312-46cb-4f8e-9704-5f2123180677 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:44 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b3f767-57aa-4334-8936-906201c8a492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0928274a-ec39-4300-a210-81a14cab8a89', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61526252-6fa3-4d91-bda5-def15cb225c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:44 devstack sudo[85918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677 1073741824
Nov 14 03:20:44 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:44 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume volume-0928274a-ec39-4300-a210-81a14cab8a89 (0928274a-ec39-4300-a210-81a14cab8a89): created successfully
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61526252-6fa3-4d91-bda5-def15cb225c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Flow 'volume_create_manager' (3ac9dacb-e094-44d3-b3cf-904cf2cada5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e6cb17b9-478d-4841-99ad-f178859ba4d8 tempest-TaggedBootDevicesTest_v242-354891865 None] Created volume successfully.
Nov 14 03:20:45 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677 1073741824" returned: 0 in 0.731s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:45 devstack sudo[85926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677
Nov 14 03:20:45 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:45 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677" returned: 0 in 0.521s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2b3634-88d5-4e9d-8b0b-f7b38c248f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd2d312-46cb-4f8e-9704-5f2123180677', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67bacfb-585f-4d87-979f-225196d5c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:45 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Volume volume-4cd2d312-46cb-4f8e-9704-5f2123180677 (4cd2d312-46cb-4f8e-9704-5f2123180677): created successfully
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67bacfb-585f-4d87-979f-225196d5c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Flow 'volume_create_manager' (31b3c692-b5c9-41e6-9fff-2793ed0300df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e9b25dd8-c4c0-45c9-9e21-cd76c2c5ed3e tempest-VolumesTransfersV357Test-1799321952 None] Created volume successfully.
Nov 14 03:20:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Acquiring lock "cinder-4cd2d312-46cb-4f8e-9704-5f2123180677-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Lock "cinder-4cd2d312-46cb-4f8e-9704-5f2123180677-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:47 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Acquiring lock "cinder-quobyte-4cd2d312-46cb-4f8e-9704-5f2123180677" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:20:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Lock "cinder-quobyte-4cd2d312-46cb-4f8e-9704-5f2123180677" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:20:47 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5517687c-2f71-4915-a208-c097b196e4d6]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:47 devstack sudo[85939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677
Nov 14 03:20:47 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:47 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677" returned: 0 in 0.722s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:47 devstack sudo[85948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677
Nov 14 03:20:47 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:48 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4cd2d312-46cb-4f8e-9704-5f2123180677" returned: 0 in 0.588s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Lock "cinder-quobyte-4cd2d312-46cb-4f8e-9704-5f2123180677" released by "delete_volume" :: held 1.338s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Created reservations ['6b42749c-7340-4a63-b2f6-ee776bfab682', 'b56b9c14-9388-4c3e-a52b-cc072e513f06', 'c196d695-cf5f-40cb-9fcf-3c7dbf3f793f', '2bb5898c-3656-459a-a9af-06168db715fa'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:48 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:20:48 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:49 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.573s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:49 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:20:49 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Deleted volume successfully.
Nov 14 03:20:49 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ac0fa33b-fa72-4d67-a61f-bf43c985f03f tempest-VolumesTransfersV357Test-2090067159 None] Lock "cinder-4cd2d312-46cb-4f8e-9704-5f2123180677-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:54 devstack sudo[85957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:20:54 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:DELETE=8,cinder:SELECT=65,cinder:INSERT=30,cinder:UPDATE=68 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=68,cinder:UPDATE=98,cinder:INSERT=19,cinder:DELETE=8 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:20:54 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Flow 'volume_create_manager' (cde88798-2b8a-485e-ac54-8d465e6c30b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fcc299-e689-4c64-a27e-1c20dcc68832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fcc299-e689-4c64-a27e-1c20dcc68832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-130307263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e2a53b-810c-4590-9d9d-492bae9d1f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9418a257c9944678bbf6f2bac08f2309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:54Z,use_quota=True,user_id='db770299e53d41ac9fa94cd2df9541e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b52c24-3fd8-4ace-b487-aed38af7ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b52c24-3fd8-4ace-b487-aed38af7ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c532437-eae3-4e0b-9b99-5f56cb2126b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c532437-eae3-4e0b-9b99-5f56cb2126b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0e2a53b-810c-4590-9d9d-492bae9d1f23', 'volume_name': 'volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed27321c60>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdca7121-5b3d-4f35-9dad-d410e4e7bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdca7121-5b3d-4f35-9dad-d410e4e7bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65bc7a1-6bfd-49e6-9b28-268058a73a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:54 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Volume e0e2a53b-810c-4590-9d9d-492bae9d1f23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed27321c60>}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Cloning e0e2a53b-810c-4590-9d9d-492bae9d1f23 from image 505e4538-4930-46f5-ae28-a520ed743bcf  at location (None, None). {{(pid=80846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:20:54 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Image download 20.69 MB at 20.69 MB/s
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e352bc55-8baa-4acc-871b-5d01e04da73b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:54 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.784s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:20:55 devstack sudo[85961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD
Nov 14 03:20:55 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:55 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:55 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf is fetched for user db770299e53d41ac9fa94cd2df9541e3. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 14 03:20:55 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5c954e-7595-4a67-afad-2bc90566fc45]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:55 devstack sudo[85970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD
Nov 14 03:20:55 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Flow 'volume_create_manager' (75fd20e2-5ef6-4ee7-8448-1cffcfcb6993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e921fbf8-9f0a-4a0d-9f0d-dcdef5786174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e921fbf8-9f0a-4a0d-9f0d-dcdef5786174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382795334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90855b9-4417-4aa7-9298-c9aea669be8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243f303cf8114034a0eb52a20b645f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:56Z,use_quota=True,user_id='a1e56c912249405b974899de23bb0790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062ea22d-a6d2-4c08-93f3-34017a6a9ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062ea22d-a6d2-4c08-93f3-34017a6a9ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20c5e3b-08d7-4625-a6ec-78f262fdcf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:56 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20c5e3b-08d7-4625-a6ec-78f262fdcf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90855b9-4417-4aa7-9298-c9aea669be8d', 'volume_name': 'volume-c90855b9-4417-4aa7-9298-c9aea669be8d', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45540ae8-42bf-4ecd-a8d4-0d3a10260456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45540ae8-42bf-4ecd-a8d4-0d3a10260456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128548ed-f7c9-4aff-910a-d5d8e14ef4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:56 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Volume c90855b9-4417-4aa7-9298-c9aea669be8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90855b9-4417-4aa7-9298-c9aea669be8d', 'volume_size': 1}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382795334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90855b9-4417-4aa7-9298-c9aea669be8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243f303cf8114034a0eb52a20b645f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:56Z,use_quota=True,user_id='a1e56c912249405b974899de23bb0790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Creating volume c90855b9-4417-4aa7-9298-c9aea669be8d {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:56 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:56 devstack sudo[85976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d 1073741824
Nov 14 03:20:56 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:57 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d 1073741824" returned: 0 in 0.737s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:57 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d
Nov 14 03:20:57 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:57 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d" returned: 0 in 0.649s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-130307263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e2a53b-810c-4590-9d9d-492bae9d1f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9418a257c9944678bbf6f2bac08f2309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:20:54Z,use_quota=True,user_id='db770299e53d41ac9fa94cd2df9541e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Creating volume e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:20:57 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:57 devstack sudo[85984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 1073741824
Nov 14 03:20:57 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128548ed-f7c9-4aff-910a-d5d8e14ef4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90855b9-4417-4aa7-9298-c9aea669be8d', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86890283-1d08-4a98-bafd-19327fe958cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:20:57 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Volume volume-c90855b9-4417-4aa7-9298-c9aea669be8d (c90855b9-4417-4aa7-9298-c9aea669be8d): created successfully
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86890283-1d08-4a98-bafd-19327fe958cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:20:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Flow 'volume_create_manager' (75fd20e2-5ef6-4ee7-8448-1cffcfcb6993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:20:57 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3bd69f70-8999-4810-b11d-735b2587034b tempest-AttachVolumeTestJSON-1434321382 None] Created volume successfully.
Nov 14 03:20:58 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 1073741824" returned: 0 in 0.574s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:58 devstack sudo[85989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:20:58 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:58 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 0 in 0.546s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:20:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:20:58 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Attempting download of 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume e0e2a53b-810c-4590-9d9d-492bae9d1f23. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:20:58 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ee711-3877-4c2a-83b9-f70d92d2b28c]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:20:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_z61gffsf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:59 devstack sudo[85992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_z61gffsf
Nov 14 03:20:59 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:20:59 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root
Nov 14 03:20:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_z61gffsf" returned: 0 in 0.654s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:20:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_z61gffsf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:20:59 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_z61gffsf
Nov 14 03:20:59 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:00 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_z61gffsf" returned: 1 in 0.662s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_z61gffsf' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:21:00 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[45985d05-3660-4e58-99a7-7ff3c248d2fa]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:00 devstack sudo[86000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD
Nov 14 03:21:00 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:00 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:00 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] 505e4538-4930-46f5-ae28-a520ed743bcf was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:21:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:00 devstack sudo[86006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:21:00 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-17811223-347d-40d3-9644-110f1e00d105 req-8c8ca8b6-ecee-49a8-bddc-cf27d7ec66be tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-17811223-347d-40d3-9644-110f1e00d105 req-8c8ca8b6-ecee-49a8-bddc-cf27d7ec66be tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:01 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa15085-3f7e-499a-92ee-4aa676d05841]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-17811223-347d-40d3-9644-110f1e00d105 req-8c8ca8b6-ecee-49a8-bddc-cf27d7ec66be tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:01 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d
Nov 14 03:21:01 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:02 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 0 in 1.331s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:02 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_op4lxuxcdevstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:21:02 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Converted 112.00 MB image at 84.05 MB/s
Nov 14 03:21:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:02 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 1G
Nov 14 03:21:02 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:02 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-17811223-347d-40d3-9644-110f1e00d105 req-8c8ca8b6-ecee-49a8-bddc-cf27d7ec66be tempest-AttachVolumeTestJSON-1434321382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d" returned: 0 in 1.188s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-17811223-347d-40d3-9644-110f1e00d105 req-8c8ca8b6-ecee-49a8-bddc-cf27d7ec66be tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.199s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-17811223-347d-40d3-9644-110f1e00d105 req-8c8ca8b6-ecee-49a8-bddc-cf27d7ec66be tempest-AttachVolumeTestJSON-1434321382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-c90855b9-4417-4aa7-9298-c9aea669be8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef8d9da9-75bb-4e3d-b776-7144e059ed55', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:21:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-17811223-347d-40d3-9644-110f1e00d105 req-8c8ca8b6-ecee-49a8-bddc-cf27d7ec66be tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-17811223-347d-40d3-9644-110f1e00d105 req-8c8ca8b6-ecee-49a8-bddc-cf27d7ec66be tempest-AttachVolumeTestJSON-1434321382 None] attachment_update completed successfully.
Nov 14 03:21:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:03 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 1G" returned: 0 in 0.886s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:03 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafb0a94-909d-4e46-8ede-0a2eb1f4b839]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:03 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248e14c-8316-4cdb-90ea-fe645b49eca4]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:03 devstack sudo[86115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:21:03 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:03 devstack sudo[86116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:21:03 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:04 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 0 in 1.006s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:04 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 0 in 1.054s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:04 devstack sudo[86442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:21:04 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:04 devstack sudo[86441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:21:04 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:04 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 1 in 0.741s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:21:04 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Downloaded image 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume e0e2a53b-810c-4590-9d9d-492bae9d1f23 successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:21:04 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf for user db770299e53d41ac9fa94cd2df9541e3 is deleted. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Marking volume e0e2a53b-810c-4590-9d9d-492bae9d1f23 as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Copying metadata from image 505e4538-4930-46f5-ae28-a520ed743bcf to e0e2a53b-810c-4590-9d9d-492bae9d1f23. {{(pid=80846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Creating volume glance metadata for volume e0e2a53b-810c-4590-9d9d-492bae9d1f23 backed by image 505e4538-4930-46f5-ae28-a520ed743bcf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65bc7a1-6bfd-49e6-9b28-268058a73a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed27321c60>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae7e432-8fd8-4611-9250-e8cf4e16df1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:05 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Volume volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 (e0e2a53b-810c-4590-9d9d-492bae9d1f23): created successfully
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae7e432-8fd8-4611-9250-e8cf4e16df1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Flow 'volume_create_manager' (cde88798-2b8a-485e-ac54-8d465e6c30b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:05 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b7b4b880-e7c2-4b69-9c96-4ae6128a0cef tempest-VolumesExtendTest-1016248275 None] Created volume successfully.
Nov 14 03:21:05 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 1 in 0.871s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.959s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-5424b32d-b747-4f02-bbb1-29f080aea40b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01065077-e9ca-4bba-a53b-fc94ed5d93f9', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:21:05 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:05 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-c9d1d243-9ba6-4ec2-b246-599884f1fdb7 tempest-TaggedBootDevicesTest_v242-354891865 None] attachment_update completed successfully.
Nov 14 03:21:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4961424-8097-4bab-9221-274acbc6faaa]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:06 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:21:06 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:06 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 0 in 0.693s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:07 devstack sudo[86461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:21:07 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-a20549df-609f-424e-a7c9-ba93cd5d40f5 tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:07 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 1 in 0.682s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 2G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 2G" returned: 0 in 0.074s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.479s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-a20549df-609f-424e-a7c9-ba93cd5d40f5 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.607s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b509a-b170-41b8-963a-9ccf9f91728f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-a20549df-609f-424e-a7c9-ba93cd5d40f5 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:07 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a1208352-c0ae-42a0-9e94-53926692e2a7 tempest-VolumesExtendTest-1016248275 None] Extend volume completed successfully.
Nov 14 03:21:07 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Flow 'volume_create_manager' (48301aa5-af9f-40c3-8d7f-ca58e34bd0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b74fc2-58e3-4425-a66f-9ef682ed867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b74fc2-58e3-4425-a66f-9ef682ed867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-427188788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4343118c-161c-4342-aac6-0bcd2343efc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243f303cf8114034a0eb52a20b645f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:08Z,use_quota=True,user_id='a1e56c912249405b974899de23bb0790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba08f14-4993-48e4-a625-cab000c7e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba08f14-4993-48e4-a625-cab000c7e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45fbfe9-ed99-4f8d-8105-a615c923e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45fbfe9-ed99-4f8d-8105-a615c923e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4343118c-161c-4342-aac6-0bcd2343efc3', 'volume_name': 'volume-4343118c-161c-4342-aac6-0bcd2343efc3', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41df6af5-f01a-4026-b0d2-e39700f56f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41df6af5-f01a-4026-b0d2-e39700f56f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775617b3-5064-4c5e-a3e2-57264c8632d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:07 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Volume 4343118c-161c-4342-aac6-0bcd2343efc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4343118c-161c-4342-aac6-0bcd2343efc3', 'volume_size': 1}
Nov 14 03:21:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:07 devstack sudo[86474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53
Nov 14 03:21:07 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:08 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-a20549df-609f-424e-a7c9-ba93cd5d40f5 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53" returned: 0 in 0.639s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-a20549df-609f-424e-a7c9-ba93cd5d40f5 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.661s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-427188788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4343118c-161c-4342-aac6-0bcd2343efc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243f303cf8114034a0eb52a20b645f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:08Z,use_quota=True,user_id='a1e56c912249405b974899de23bb0790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Creating volume 4343118c-161c-4342-aac6-0bcd2343efc3 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:21:08 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:08 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3 1073741824
Nov 14 03:21:08 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-a20549df-609f-424e-a7c9-ba93cd5d40f5 tempest-TaggedBootDevicesTest_v242-354891865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-c4716f97-dec5-4742-b178-d3f6e9699f53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec46b3b2-fd2e-45cc-abb0-eecda0a851c1', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:21:08 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-a20549df-609f-424e-a7c9-ba93cd5d40f5 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:08 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-a20549df-609f-424e-a7c9-ba93cd5d40f5 tempest-TaggedBootDevicesTest_v242-354891865 None] attachment_update completed successfully.
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Acquiring lock "cinder-e0e2a53b-810c-4590-9d9d-492bae9d1f23-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Lock "cinder-e0e2a53b-810c-4590-9d9d-492bae9d1f23-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:08 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Acquiring lock "cinder-quobyte-e0e2a53b-810c-4590-9d9d-492bae9d1f23" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Lock "cinder-quobyte-e0e2a53b-810c-4590-9d9d-492bae9d1f23" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3ccebe-216c-4291-b107-20f9a5a83475]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:08 devstack sudo[86483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:21:08 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:09 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3 1073741824" returned: 0 in 0.885s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:09 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3
Nov 14 03:21:09 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:09 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 0 in 0.841s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:09 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:21:09 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:09 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3" returned: 0 in 0.657s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775617b3-5064-4c5e-a3e2-57264c8632d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4343118c-161c-4342-aac6-0bcd2343efc3', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b33e51-d765-4d3f-a363-cd2307e86223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:09 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Volume volume-4343118c-161c-4342-aac6-0bcd2343efc3 (4343118c-161c-4342-aac6-0bcd2343efc3): created successfully
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b33e51-d765-4d3f-a363-cd2307e86223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Flow 'volume_create_manager' (48301aa5-af9f-40c3-8d7f-ca58e34bd0ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:09 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-22bc6c4e-474e-454f-9ba0-f23238907bd1 tempest-AttachVolumeTestJSON-1434321382 None] Created volume successfully.
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-35cbc2db-db98-493c-8a20-e8edcf3f5e93 tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-35cbc2db-db98-493c-8a20-e8edcf3f5e93 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[54919947-3d01-43d1-ba2c-77dd77415cc1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-35cbc2db-db98-493c-8a20-e8edcf3f5e93 tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:10 devstack sudo[86505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89
Nov 14 03:21:10 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:10 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 1 in 0.973s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:10 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23
Nov 14 03:21:10 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:10 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-35cbc2db-db98-493c-8a20-e8edcf3f5e93 tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89" returned: 0 in 0.792s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-35cbc2db-db98-493c-8a20-e8edcf3f5e93 tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-35cbc2db-db98-493c-8a20-e8edcf3f5e93 tempest-TaggedBootDevicesTest_v242-354891865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-0928274a-ec39-4300-a210-81a14cab8a89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9ef8f53-0416-4e89-aeeb-ff49cf60edc5', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:21:10 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-35cbc2db-db98-493c-8a20-e8edcf3f5e93 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-18be69c5-2ad2-4628-9929-4c97253ac94e req-35cbc2db-db98-493c-8a20-e8edcf3f5e93 tempest-TaggedBootDevicesTest_v242-354891865 None] attachment_update completed successfully.
Nov 14 03:21:11 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0e2a53b-810c-4590-9d9d-492bae9d1f23" returned: 0 in 0.601s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Lock "cinder-quobyte-e0e2a53b-810c-4590-9d9d-492bae9d1f23" released by "delete_volume" :: held 2.485s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Created reservations ['788bbd70-be5c-4170-8db1-73e162f9a7dd', 'ebe83776-3b8e-4b66-b3cd-888201a410b8', '9d211abc-1734-4611-8a63-f72fc462864f', '4a7e6c0d-af5b-4d37-9196-40a617d5f8c1'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:11 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:21:11 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:11 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.566s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:21:11 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Deleted volume successfully.
Nov 14 03:21:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d8c8b353-572f-49a8-802f-21b354b016be tempest-VolumesExtendTest-1016248275 None] Lock "cinder-e0e2a53b-810c-4590-9d9d-492bae9d1f23-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Flow 'volume_create_manager' (abfbf691-2187-40da-a11c-9619a4722009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08313bea-c888-4dd3-a354-f97e51479f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08313bea-c888-4dd3-a354-f97e51479f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1386884712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78156536-74bd-410d-972b-889caecd6835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9418a257c9944678bbf6f2bac08f2309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:12Z,use_quota=True,user_id='db770299e53d41ac9fa94cd2df9541e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8be66e-a6c7-48ae-888d-1eca54bf560a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8be66e-a6c7-48ae-888d-1eca54bf560a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59169ae9-b8b3-403f-a9bc-a5cdec5aa3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59169ae9-b8b3-403f-a9bc-a5cdec5aa3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78156536-74bd-410d-972b-889caecd6835', 'volume_name': 'volume-78156536-74bd-410d-972b-889caecd6835', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68a379e-9127-485c-935d-3bece5b43bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68a379e-9127-485c-935d-3bece5b43bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74493e3b-e3f9-4b67-91aa-d5d50634dca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Volume 78156536-74bd-410d-972b-889caecd6835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78156536-74bd-410d-972b-889caecd6835', 'volume_size': 1}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1386884712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78156536-74bd-410d-972b-889caecd6835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9418a257c9944678bbf6f2bac08f2309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:12Z,use_quota=True,user_id='db770299e53d41ac9fa94cd2df9541e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Creating volume 78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:21:12 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:12 devstack sudo[86536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 1073741824
Nov 14 03:21:12 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:12 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 1073741824" returned: 0 in 0.670s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:12 devstack sudo[86545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835
Nov 14 03:21:12 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:13 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835" returned: 0 in 0.583s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74493e3b-e3f9-4b67-91aa-d5d50634dca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78156536-74bd-410d-972b-889caecd6835', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c0fca1-5d4b-41a5-b3c1-5adf7fff6976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Volume volume-78156536-74bd-410d-972b-889caecd6835 (78156536-74bd-410d-972b-889caecd6835): created successfully
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c0fca1-5d4b-41a5-b3c1-5adf7fff6976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Flow 'volume_create_manager' (abfbf691-2187-40da-a11c-9619a4722009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d4e784a0-3eb8-4b12-b143-728f091efa6a tempest-VolumesExtendTest-1016248275 None] Created volume successfully.
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d15edcb4-e97f-468a-8217-113559dc2323 req-78a40049-025c-47e0-a607-0351f7fc1721 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d15edcb4-e97f-468a-8217-113559dc2323 req-78a40049-025c-47e0-a607-0351f7fc1721 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8700286d-48c5-4eb4-b1bd-135d8b4aa858]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d15edcb4-e97f-468a-8217-113559dc2323 req-78a40049-025c-47e0-a607-0351f7fc1721 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:13 devstack sudo[86556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3
Nov 14 03:21:13 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:14 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d15edcb4-e97f-468a-8217-113559dc2323 req-78a40049-025c-47e0-a607-0351f7fc1721 tempest-AttachVolumeTestJSON-1434321382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3" returned: 0 in 1.034s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d15edcb4-e97f-468a-8217-113559dc2323 req-78a40049-025c-47e0-a607-0351f7fc1721 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.047s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.253s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Creating offline snapshot bd9f1027-681a-4004-8301-f0f440752c0c of volume 78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:21:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2ade7d-9680-4bc7-8242-2e52d8deda75]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-d15edcb4-e97f-468a-8217-113559dc2323 req-78a40049-025c-47e0-a607-0351f7fc1721 tempest-AttachVolumeTestJSON-1434321382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-4343118c-161c-4342-aac6-0bcd2343efc3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3a953a8-1bec-486c-bd00-2bed8e42ba23', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:21:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-d15edcb4-e97f-468a-8217-113559dc2323 req-78a40049-025c-47e0-a607-0351f7fc1721 tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-d15edcb4-e97f-468a-8217-113559dc2323 req-78a40049-025c-47e0-a607-0351f7fc1721 tempest-AttachVolumeTestJSON-1434321382 None] attachment_update completed successfully.
Nov 14 03:21:15 devstack sudo[86622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835
Nov 14 03:21:15 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:15 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835" returned: 0 in 0.635s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:15 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c 1G
Nov 14 03:21:15 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:16 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c 1G" returned: 0 in 0.558s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78156536-74bd-410d-972b-889caecd6835 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:16 devstack sudo[86641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78156536-74bd-410d-972b-889caecd6835 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c
Nov 14 03:21:16 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:16 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78156536-74bd-410d-972b-889caecd6835 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c" returned: 0 in 0.522s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:16 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c is being set with open permissions: ugo+rw
Nov 14 03:21:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:16 devstack sudo[86646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c
Nov 14 03:21:16 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:17 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c" returned: 0 in 0.486s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:17 devstack sudo[86649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.info
Nov 14 03:21:17 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:17 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.info" returned: 0 in 0.544s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:17 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.info is being set with open permissions: ugo+rw
Nov 14 03:21:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:17 devstack sudo[86664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.info
Nov 14 03:21:17 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:18 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.info" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.281s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:18 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-de51d383-2c32-4a48-8287-b5664ccf32c3 tempest-VolumesExtendTest-1016248275 None] Create snapshot completed successfully
Nov 14 03:21:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a1c87a-a8a3-40ea-9e62-9b78b094ece1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:18 devstack sudo[86689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835
Nov 14 03:21:18 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:19 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835" returned: 0 in 0.607s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c 2G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c 2G" returned: 0 in 0.099s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.733s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-254f3dbb-6bad-44d1-900f-312aea20055a tempest-VolumesExtendTest-1016248275 None] Extend volume completed successfully.
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Acquiring lock "cinder-bd9f1027-681a-4004-8301-f0f440752c0c-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Lock "cinder-bd9f1027-681a-4004-8301-f0f440752c0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Acquiring lock "cinder-quobyte-78156536-74bd-410d-972b-889caecd6835" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Lock "cinder-quobyte-78156536-74bd-410d-972b-889caecd6835" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Acquiring lock "cinder-quobyte-bd9f1027-681a-4004-8301-f0f440752c0c" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Lock "cinder-quobyte-bd9f1027-681a-4004-8301-f0f440752c0c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Deleting offline snapshot bd9f1027-681a-4004-8301-f0f440752c0c of volume 78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] snapshot_file for this snap is: volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e03be0-6d38-47bd-b98e-43189c109e88]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:20 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c
Nov 14 03:21:20 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:20 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c" returned: 0 in 0.612s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78156536-74bd-410d-972b-889caecd6835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b827997d-c972-4cfb-8b52-ed95c1165564]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:20 devstack sudo[86705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835
Nov 14 03:21:20 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:21 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835" returned: 0 in 0.714s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:21 devstack sudo[86715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c
Nov 14 03:21:21 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:22 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:21:22 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Flow 'volume_create_manager' (5f9299c9-5e92-4390-ba32-e0ae09a7e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ad85ad-e1c8-4822-8c90-5d9a5aee5d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ad85ad-e1c8-4822-8c90-5d9a5aee5d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-407469131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089fb093-a5a6-4802-ac51-666d087817ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9fc2313a164376a0cd4120facccc86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:22Z,use_quota=True,user_id='4023b5b27be84a98a624ccad4c2f3955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300eaba7-9eaa-4728-b1c0-c806c923d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300eaba7-9eaa-4728-b1c0-c806c923d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd748c0-f4b8-4513-9723-9e2ff130322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd748c0-f4b8-4513-9723-9e2ff130322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089fb093-a5a6-4802-ac51-666d087817ff', 'volume_name': 'volume-089fb093-a5a6-4802-ac51-666d087817ff', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfd0051-a629-4115-a433-7ca0a77cdae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfd0051-a629-4115-a433-7ca0a77cdae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007510e6-2791-48e0-8500-f0d4cda30cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:22 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Volume 089fb093-a5a6-4802-ac51-666d087817ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089fb093-a5a6-4802-ac51-666d087817ff', 'volume_size': 1}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-407469131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089fb093-a5a6-4802-ac51-666d087817ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9fc2313a164376a0cd4120facccc86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:22Z,use_quota=True,user_id='4023b5b27be84a98a624ccad4c2f3955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Creating volume 089fb093-a5a6-4802-ac51-666d087817ff {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:21:22 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:22 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-872252e9-9e14-47e6-ae65-9b74f65bf5c7 req-1a42bfa7-aa36-4233-b84f-a52d7562e6d6 tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:22 devstack sudo[86816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff 1073741824
Nov 14 03:21:22 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c" returned: 0 in 0.940s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:22 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-872252e9-9e14-47e6-ae65-9b74f65bf5c7 req-1a42bfa7-aa36-4233-b84f-a52d7562e6d6 tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:22 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-872252e9-9e14-47e6-ae65-9b74f65bf5c7 req-1a42bfa7-aa36-4233-b84f-a52d7562e6d6 tempest-AttachVolumeTestJSON-1434321382 None] Terminate volume connection completed successfully.
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-872252e9-9e14-47e6-ae65-9b74f65bf5c7 req-1a42bfa7-aa36-4233-b84f-a52d7562e6d6 tempest-AttachVolumeTestJSON-1434321382 None] Deleting attachment ef8d9da9-75bb-4e3d-b776-7144e059ed55. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:21:22 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c
Nov 14 03:21:22 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:22 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835.bd9f1027-681a-4004-8301-f0f440752c0c" returned: 0 in 0.539s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Lock "cinder-quobyte-bd9f1027-681a-4004-8301-f0f440752c0c" released by "_delete_snapshot" :: held 2.899s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Lock "cinder-quobyte-78156536-74bd-410d-972b-889caecd6835" released by "delete_snapshot" :: held 2.913s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:22 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff 1073741824" returned: 0 in 0.613s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:22 devstack sudo[86824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff
Nov 14 03:21:22 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Created reservations ['a8858d86-7284-4fff-8594-70a88695e6a6', 'e750e38e-f134-4ce0-8a6e-a3ccd4aa6344', '937e79de-94bb-45f0-b821-ebe9eb844a0c', '473e519d-7a8c-44e8-ba00-cbb77140a9cf'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:21:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Delete snapshot completed successfully.
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-46697f18-4912-460a-8d62-3a58e0739632 tempest-VolumesExtendTest-1016248275 None] Lock "cinder-bd9f1027-681a-4004-8301-f0f440752c0c-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Acquiring lock "cinder-78156536-74bd-410d-972b-889caecd6835-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Lock "cinder-78156536-74bd-410d-972b-889caecd6835-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:23 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Acquiring lock "cinder-quobyte-78156536-74bd-410d-972b-889caecd6835" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Lock "cinder-quobyte-78156536-74bd-410d-972b-889caecd6835" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[76599a68-db75-47b0-a3f0-d6112c80f80e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:23 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835
Nov 14 03:21:23 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:23 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff" returned: 0 in 0.661s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007510e6-2791-48e0-8500-f0d4cda30cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089fb093-a5a6-4802-ac51-666d087817ff', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37deb61-8efd-475d-8927-411a9395405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:23 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Volume volume-089fb093-a5a6-4802-ac51-666d087817ff (089fb093-a5a6-4802-ac51-666d087817ff): created successfully
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37deb61-8efd-475d-8927-411a9395405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Flow 'volume_create_manager' (5f9299c9-5e92-4390-ba32-e0ae09a7e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6f43cae1-a07e-4a83-a46b-524e6a42f571 tempest-DeleteServersTestJSON-39085503 None] Created volume successfully.
Nov 14 03:21:24 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835" returned: 0 in 0.675s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:24 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835
Nov 14 03:21:24 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:25 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78156536-74bd-410d-972b-889caecd6835" returned: 0 in 1.235s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Lock "cinder-quobyte-78156536-74bd-410d-972b-889caecd6835" released by "delete_volume" :: held 1.964s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Created reservations ['4bee1ee3-515a-4757-8261-14f3e9f18b4e', '47f5ce9f-06e6-43b2-97b1-0e7bf31c2324', 'a504b9b6-ab1a-4664-abcb-2d680210dbb3', '767cdc06-5c01-44a6-bcbf-9aedd0df73fb'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:25 devstack sudo[86979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:21:25 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:27 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 1.482s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:27 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:21:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Deleted volume successfully.
Nov 14 03:21:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eb23c7e3-2deb-4d6a-b15a-cffb3076f0ed tempest-VolumesExtendTest-1016248275 None] Lock "cinder-78156536-74bd-410d-972b-889caecd6835-delete_volume" released by "delete_volume" :: held 3.996s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-0799d205-8f54-420b-aa5d-3e47eb5c2082 req-997bbff1-2107-42c0-b453-1c503c46b52f tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-0799d205-8f54-420b-aa5d-3e47eb5c2082 req-997bbff1-2107-42c0-b453-1c503c46b52f tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-0799d205-8f54-420b-aa5d-3e47eb5c2082 req-997bbff1-2107-42c0-b453-1c503c46b52f tempest-AttachVolumeTestJSON-1434321382 None] Terminate volume connection completed successfully.
Nov 14 03:21:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-0799d205-8f54-420b-aa5d-3e47eb5c2082 req-997bbff1-2107-42c0-b453-1c503c46b52f tempest-AttachVolumeTestJSON-1434321382 None] Deleting attachment d3a953a8-1bec-486c-bd00-2bed8e42ba23. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:21:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-6cf81e1e-1466-49b4-8477-fe722e342e98 req-08d4b979-3b13-47cc-b6dd-a4ad12a97a28 tempest-DeleteServersTestJSON-39085503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-6cf81e1e-1466-49b4-8477-fe722e342e98 req-08d4b979-3b13-47cc-b6dd-a4ad12a97a28 tempest-DeleteServersTestJSON-39085503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:28 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b6c7cf-44a1-4698-84f6-81077f53eb92]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-6cf81e1e-1466-49b4-8477-fe722e342e98 req-08d4b979-3b13-47cc-b6dd-a4ad12a97a28 tempest-DeleteServersTestJSON-39085503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:28 devstack sudo[87074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff
Nov 14 03:21:28 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:29 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-6cf81e1e-1466-49b4-8477-fe722e342e98 req-08d4b979-3b13-47cc-b6dd-a4ad12a97a28 tempest-DeleteServersTestJSON-39085503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff" returned: 0 in 0.873s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-6cf81e1e-1466-49b4-8477-fe722e342e98 req-08d4b979-3b13-47cc-b6dd-a4ad12a97a28 tempest-DeleteServersTestJSON-39085503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-6cf81e1e-1466-49b4-8477-fe722e342e98 req-08d4b979-3b13-47cc-b6dd-a4ad12a97a28 tempest-DeleteServersTestJSON-39085503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-089fb093-a5a6-4802-ac51-666d087817ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '950ccbfb-f61b-4ca8-b583-518b229e2aac', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:21:29 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-6cf81e1e-1466-49b4-8477-fe722e342e98 req-08d4b979-3b13-47cc-b6dd-a4ad12a97a28 tempest-DeleteServersTestJSON-39085503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-6cf81e1e-1466-49b4-8477-fe722e342e98 req-08d4b979-3b13-47cc-b6dd-a4ad12a97a28 tempest-DeleteServersTestJSON-39085503 None] attachment_update completed successfully.
Nov 14 03:21:38 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-1d02aad7-5c84-4e75-a0ec-5158b93a638d req-502b01ae-00d3-4bdb-8e37-1af54e2f69a3 tempest-DeleteServersTestJSON-39085503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:38 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-1d02aad7-5c84-4e75-a0ec-5158b93a638d req-502b01ae-00d3-4bdb-8e37-1af54e2f69a3 tempest-DeleteServersTestJSON-39085503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:38 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-1d02aad7-5c84-4e75-a0ec-5158b93a638d req-502b01ae-00d3-4bdb-8e37-1af54e2f69a3 tempest-DeleteServersTestJSON-39085503 None] Terminate volume connection completed successfully.
Nov 14 03:21:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-1d02aad7-5c84-4e75-a0ec-5158b93a638d req-502b01ae-00d3-4bdb-8e37-1af54e2f69a3 tempest-DeleteServersTestJSON-39085503 None] Deleting attachment 950ccbfb-f61b-4ca8-b583-518b229e2aac. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:21:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "cinder-4343118c-161c-4342-aac6-0bcd2343efc3-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-4343118c-161c-4342-aac6-0bcd2343efc3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "cinder-quobyte-4343118c-161c-4342-aac6-0bcd2343efc3" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-quobyte-4343118c-161c-4342-aac6-0bcd2343efc3" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13b62e-4cc0-4c86-99dc-f472ae6a685b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:40 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3
Nov 14 03:21:40 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:40 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3" returned: 0 in 0.588s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:40 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3
Nov 14 03:21:40 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (077f9ea4-c6fa-450f-a679-2fd66774ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61bf86f-eec2-495a-ae91-e5c9cf95dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61bf86f-eec2-495a-ae91-e5c9cf95dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2108158672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2631f1ee-ab4a-47ac-99ec-0824d9709b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82f94d3f3e4e40b296df88c4b04267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:41Z,use_quota=True,user_id='edb26d6cde9d4a07bdd7b5ef8d05ce83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ad946b-b37e-44d4-b35c-b3004376449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ad946b-b37e-44d4-b35c-b3004376449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e96565-dfb1-45ee-ba0a-7d10cabd43fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e96565-dfb1-45ee-ba0a-7d10cabd43fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2631f1ee-ab4a-47ac-99ec-0824d9709b8e', 'volume_name': 'volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b34b616-f831-4fb3-8040-e1d4a4fee413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b34b616-f831-4fb3-8040-e1d4a4fee413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea46409-0641-4071-b494-a7e3e3c819ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:40 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Volume 2631f1ee-ab4a-47ac-99ec-0824d9709b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e', 'volume_size': 1}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2108158672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2631f1ee-ab4a-47ac-99ec-0824d9709b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82f94d3f3e4e40b296df88c4b04267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:41Z,use_quota=True,user_id='edb26d6cde9d4a07bdd7b5ef8d05ce83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Creating volume 2631f1ee-ab4a-47ac-99ec-0824d9709b8e {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:21:41 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:41 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e 1073741824
Nov 14 03:21:41 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:41 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4343118c-161c-4342-aac6-0bcd2343efc3" returned: 0 in 0.566s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-quobyte-4343118c-161c-4342-aac6-0bcd2343efc3" released by "delete_volume" :: held 1.201s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Created reservations ['7ef54da1-0e98-4bea-8e33-ff99501acc78', 'c0b5a43c-3f93-4c9d-ad50-aa8f7318ecc3', '9550dfc7-7c3b-42a6-ae7c-598296383c03', 'a19ad085-75dc-44e0-98bd-667ff9778d6d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:41 devstack sudo[87178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:21:41 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:41 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e 1073741824" returned: 0 in 0.630s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:41 devstack sudo[87183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e
Nov 14 03:21:41 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:41 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.514s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:21:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Deleted volume successfully.
Nov 14 03:21:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-958b55c0-cbef-4dd6-87d4-32853b068315 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-4343118c-161c-4342-aac6-0bcd2343efc3-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "cinder-c90855b9-4417-4aa7-9298-c9aea669be8d-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-c90855b9-4417-4aa7-9298-c9aea669be8d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:42 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" returned: 0 in 0.515s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea46409-0641-4071-b494-a7e3e3c819ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8df5a2a-7a6e-489b-9697-8c22eb5cd1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:42 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Volume volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e (2631f1ee-ab4a-47ac-99ec-0824d9709b8e): created successfully
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8df5a2a-7a6e-489b-9697-8c22eb5cd1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (077f9ea4-c6fa-450f-a679-2fd66774ea73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:42 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "cinder-quobyte-c90855b9-4417-4aa7-9298-c9aea669be8d" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:42 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5ca5ff3e-225d-4f29-9c26-1abadc155983 tempest-VolumesSnapshotTestJSON-537128668 None] Created volume successfully.
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-quobyte-c90855b9-4417-4aa7-9298-c9aea669be8d" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[90270a1f-f553-401e-adb7-ded9173cdbce]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:42 devstack sudo[87187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d
Nov 14 03:21:42 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Acquiring lock "cinder-089fb093-a5a6-4802-ac51-666d087817ff-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Lock "cinder-089fb093-a5a6-4802-ac51-666d087817ff-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:42 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Acquiring lock "cinder-quobyte-089fb093-a5a6-4802-ac51-666d087817ff" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Lock "cinder-quobyte-089fb093-a5a6-4802-ac51-666d087817ff" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a739bd-ca35-4096-b46b-b633834b94cc]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:42 devstack sudo[87189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff
Nov 14 03:21:42 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:42 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d" returned: 0 in 0.626s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:42 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d
Nov 14 03:21:42 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:43 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff" returned: 0 in 0.626s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:43 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff
Nov 14 03:21:43 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Creating offline snapshot d51679cf-45bb-4cdb-bf6f-4429b1af3038 of volume 2631f1ee-ab4a-47ac-99ec-0824d9709b8e {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b8842a-e73c-4d4b-b316-3222e8b1800e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:43 devstack sudo[87203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e
Nov 14 03:21:43 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:43 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c90855b9-4417-4aa7-9298-c9aea669be8d" returned: 0 in 0.553s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-quobyte-c90855b9-4417-4aa7-9298-c9aea669be8d" released by "delete_volume" :: held 1.203s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Created reservations ['867c8c9d-cd4b-44f3-bfbc-cdf39981ad01', 'deaaf278-4be2-474a-a240-d79f267bd05a', '47780a7c-e78e-4a10-ae0c-afecd8f66ad2', 'd5891879-4459-417a-9a75-6d8ef9c792fa'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:43 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:21:43 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:43 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-089fb093-a5a6-4802-ac51-666d087817ff" returned: 0 in 0.552s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Lock "cinder-quobyte-089fb093-a5a6-4802-ac51-666d087817ff" released by "delete_volume" :: held 1.206s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Created reservations ['91f119dc-e735-471a-b5d0-a66c76e1f7b5', '4b2b5631-3115-4550-bff2-c3757fe4d490', '896da292-2beb-4daf-bf21-9d693a3a9bc3', '2a09981e-489b-4e2d-a573-ce7f71f9c79d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:43 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:21:43 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:43 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" returned: 0 in 0.695s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:43 devstack sudo[87214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 1G
Nov 14 03:21:43 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:44 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.523s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:21:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Deleted volume successfully.
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ddde0203-d767-4e77-ab27-b11168ac0f79 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-c90855b9-4417-4aa7-9298-c9aea669be8d-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:44 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.490s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:21:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Deleted volume successfully.
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3580665-beb7-4565-8ae4-6494099d7aee tempest-DeleteServersTestJSON-39085503 None] Lock "cinder-089fb093-a5a6-4802-ac51-666d087817ff-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "cinder-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:44 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "cinder-quobyte-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-quobyte-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60020c7-17e7-4c8a-8fec-1891cb107fe1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:44 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5
Nov 14 03:21:44 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:44 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 1G" returned: 0 in 0.699s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:44 devstack sudo[87223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038
Nov 14 03:21:44 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:45 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5" returned: 0 in 0.610s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:45 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5
Nov 14 03:21:45 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:45 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038" returned: 0 in 0.533s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:45 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 is being set with open permissions: ugo+rw
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:45 devstack sudo[87233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038
Nov 14 03:21:45 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:45 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5" returned: 0 in 0.548s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-quobyte-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5" released by "delete_volume" :: held 1.187s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Created reservations ['a68c48e3-99a8-428f-b6be-2bb3ebf27378', '9ecf33a7-f371-44a0-ab9e-72a231f6d7c2', '1c016fce-7446-44c8-bce6-afe1bed82caf', '3c52a324-487b-4352-8211-3bf866c341d8'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:21:45 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038" returned: 0 in 0.534s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:45 devstack sudo[87237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.info
Nov 14 03:21:45 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:45 devstack sudo[87239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:21:45 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:46 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.info" returned: 0 in 0.536s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:46 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.info is being set with open permissions: ugo+rw
Nov 14 03:21:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:46 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.info
Nov 14 03:21:46 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:46 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.553s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:46 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:21:46 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Deleted volume successfully.
Nov 14 03:21:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-eba727e6-0f36-45b4-b3e5-3d1502813776 tempest-AttachVolumeTestJSON-1434321382 None] Lock "cinder-ef2cc584-3f4b-4e30-b107-d87d2dc3faf5-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:46 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.info" returned: 0 in 0.539s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.621s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:46 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9cf14207-4cdd-4357-bdfd-7a5a44daee89 tempest-VolumesSnapshotTestJSON-537128668 None] Create snapshot completed successfully
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-d51679cf-45bb-4cdb-bf6f-4429b1af3038-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-d51679cf-45bb-4cdb-bf6f-4429b1af3038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:47 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-d51679cf-45bb-4cdb-bf6f-4429b1af3038" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-d51679cf-45bb-4cdb-bf6f-4429b1af3038" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Deleting offline snapshot d51679cf-45bb-4cdb-bf6f-4429b1af3038 of volume 2631f1ee-ab4a-47ac-99ec-0824d9709b8e {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] snapshot_file for this snap is: volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df1adbb-0a99-4c14-98f9-fc837368ff4c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:47 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038
Nov 14 03:21:47 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:48 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038" returned: 0 in 0.756s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:21:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8231ab0f-8733-43a3-aee1-dd7595df712f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:48 devstack sudo[87254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e
Nov 14 03:21:48 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:49 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" returned: 0 in 0.735s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:49 devstack sudo[87259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038
Nov 14 03:21:49 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:49 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038" returned: 0 in 0.754s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:49 devstack sudo[87264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038
Nov 14 03:21:49 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:50 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e.d51679cf-45bb-4cdb-bf6f-4429b1af3038" returned: 0 in 0.675s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-d51679cf-45bb-4cdb-bf6f-4429b1af3038" released by "_delete_snapshot" :: held 3.048s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" released by "delete_snapshot" :: held 3.073s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:50 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Created reservations ['6526bf49-dfac-414b-a0a1-a624387c68c5', '4ce279ef-041c-4875-8919-4e982ce89fd3', '27b2fdec-07b5-429a-ad5b-87dd12d7be73', '1fc0c8d1-cb33-4bcd-8e0a-52372cf4b718'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:21:50 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Delete snapshot completed successfully.
Nov 14 03:21:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-aa5e0847-75a7-4941-b79c-7ecf28a9251a tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-d51679cf-45bb-4cdb-bf6f-4429b1af3038-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:21:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (ab8f07ac-8a6d-449c-bee8-a3dec64e7423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99472d8b-f2e0-4b8f-8196-9290a362c338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99472d8b-f2e0-4b8f-8196-9290a362c338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-971875904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787bcb4d-987f-4715-a4be-4ed122da1643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82f94d3f3e4e40b296df88c4b04267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:52Z,use_quota=True,user_id='edb26d6cde9d4a07bdd7b5ef8d05ce83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6005ef-6c3d-41ea-b51b-4de5e4e0e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6005ef-6c3d-41ea-b51b-4de5e4e0e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2a5815-583f-4313-b636-7d200b6ebd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2a5815-583f-4313-b636-7d200b6ebd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787bcb4d-987f-4715-a4be-4ed122da1643', 'volume_name': 'volume-787bcb4d-987f-4715-a4be-4ed122da1643', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601662b3-bca5-4ed6-b8c3-13fb5567c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601662b3-bca5-4ed6-b8c3-13fb5567c628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d869a98-77d8-4d23-9b37-c3bf28f69050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:52 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Volume 787bcb4d-987f-4715-a4be-4ed122da1643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787bcb4d-987f-4715-a4be-4ed122da1643', 'volume_size': 1}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-971875904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787bcb4d-987f-4715-a4be-4ed122da1643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82f94d3f3e4e40b296df88c4b04267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:21:52Z,use_quota=True,user_id='edb26d6cde9d4a07bdd7b5ef8d05ce83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Creating volume 787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:21:52 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:52 devstack sudo[87269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 1073741824
Nov 14 03:21:52 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:52 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 1073741824" returned: 0 in 0.743s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:52 devstack sudo[87274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643
Nov 14 03:21:52 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:53 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643" returned: 0 in 0.576s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:21:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d869a98-77d8-4d23-9b37-c3bf28f69050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787bcb4d-987f-4715-a4be-4ed122da1643', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe1c906-8948-4b68-a61d-a25609b7b045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:21:53 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Volume volume-787bcb4d-987f-4715-a4be-4ed122da1643 (787bcb4d-987f-4715-a4be-4ed122da1643): created successfully
Nov 14 03:21:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe1c906-8948-4b68-a61d-a25609b7b045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:21:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (ab8f07ac-8a6d-449c-bee8-a3dec64e7423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:21:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-922eafd5-b9dd-498e-bdc3-8a027da99f96 tempest-VolumesSnapshotTestJSON-537128668 None] Created volume successfully.
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:54 devstack sudo[87277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:21:54 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=108,cinder:UPDATE=96,cinder:INSERT=23,cinder:DELETE=4 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=95,cinder:INSERT=22,cinder:UPDATE=86,cinder:DELETE=11 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:21:54 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Creating offline snapshot 5c23e1df-a514-445a-a54b-d5a9799c489b of volume 787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f95423-0430-42d5-b680-b1dbcc3c57b1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:54 devstack sudo[87279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643
Nov 14 03:21:54 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:54 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.682s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:21:55 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643" returned: 0 in 0.706s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:55 devstack sudo[87285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b 1G
Nov 14 03:21:55 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:56 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b 1G" returned: 0 in 0.742s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787bcb4d-987f-4715-a4be-4ed122da1643 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:56 devstack sudo[87290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787bcb4d-987f-4715-a4be-4ed122da1643 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b
Nov 14 03:21:56 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:56 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787bcb4d-987f-4715-a4be-4ed122da1643 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b" returned: 0 in 0.758s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:56 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b is being set with open permissions: ugo+rw
Nov 14 03:21:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:56 devstack sudo[87295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b
Nov 14 03:21:56 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:57 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:57 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.info
Nov 14 03:21:57 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:58 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.info" returned: 0 in 0.754s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:58 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.info is being set with open permissions: ugo+rw
Nov 14 03:21:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:21:58 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.info
Nov 14 03:21:58 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:21:58 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Nov 14 03:21:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.info" returned: 0 in 0.697s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:21:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.317s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:21:58 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2ed44023-6214-4f9e-9eb1-bae396200b6e tempest-VolumesSnapshotTestJSON-537128668 None] Create snapshot completed successfully
Nov 14 03:22:00 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (40549ad9-fb4f-419a-9981-8f6400641373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e38e99c-ed0a-4cd1-a787-3869859e0fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e38e99c-ed0a-4cd1-a787-3869859e0fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2109878007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efa10ea-9331-407b-b601-1e565ca9bb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82f94d3f3e4e40b296df88c4b04267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5c23e1df-a514-445a-a54b-d5a9799c489b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:00Z,use_quota=True,user_id='edb26d6cde9d4a07bdd7b5ef8d05ce83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896e76d1-f11d-4d87-b98f-a7f46da5188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896e76d1-f11d-4d87-b98f-a7f46da5188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f274b940-eba4-42f8-9178-fa135a7eaf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f274b940-eba4-42f8-9178-fa135a7eaf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1efa10ea-9331-407b-b601-1e565ca9bb2e', 'volume_name': 'volume-1efa10ea-9331-407b-b601-1e565ca9bb2e', 'volume_size': 2, 'snapshot_id': '5c23e1df-a514-445a-a54b-d5a9799c489b'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0baeddde-2809-4af0-9976-148284ff2700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0baeddde-2809-4af0-9976-148284ff2700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb270bb8-90d9-403e-8670-c68606b441a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:00 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Volume 1efa10ea-9331-407b-b601-1e565ca9bb2e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1efa10ea-9331-407b-b601-1e565ca9bb2e', 'volume_size': 2, 'snapshot_id': '5c23e1df-a514-445a-a54b-d5a9799c489b'}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-5c23e1df-a514-445a-a54b-d5a9799c489b-1efa10ea-9331-407b-b601-1e565ca9bb2e" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-5c23e1df-a514-445a-a54b-d5a9799c489b-1efa10ea-9331-407b-b601-1e565ca9bb2e" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Creating volume 1efa10ea-9331-407b-b601-1e565ca9bb2e from snapshot 5c23e1df-a514-445a-a54b-d5a9799c489b {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-1efa10ea-9331-407b-b601-1e565ca9bb2e" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-1efa10ea-9331-407b-b601-1e565ca9bb2e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] snapshot: 5c23e1df-a514-445a-a54b-d5a9799c489b, volume: 1efa10ea-9331-407b-b601-1e565ca9bb2e,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb10dfc-2588-4189-b642-86068d58ffe3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:00 devstack sudo[87309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b
Nov 14 03:22:00 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:01 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b" returned: 0 in 0.851s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787bcb4d-987f-4715-a4be-4ed122da1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:22:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:22:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:22:01 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f0e42a-6eb4-4f8f-b2e8-5750d99a161f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:01 devstack sudo[87314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643
Nov 14 03:22:01 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:02 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643" returned: 0 in 0.785s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:02 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:22:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:02 devstack sudo[87322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e
Nov 14 03:22:02 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:05 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e" returned: 0 in 3.348s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:05 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a8f0da-5329-4550-ba9d-e4164319c676]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:05 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643
Nov 14 03:22:05 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:06 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643" returned: 0 in 0.993s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:06 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643, size 1024.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:22:06 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Converted 1024.00 MB image at 305.66 MB/s
Nov 14 03:22:06 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e is being set with open permissions: ugo+rw
Nov 14 03:22:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:06 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e
Nov 14 03:22:06 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:07 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e" returned: 0 in 0.716s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-1efa10ea-9331-407b-b601-1e565ca9bb2e" released by "_copy_volume_from_snapshot" :: held 6.852s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-5c23e1df-a514-445a-a54b-d5a9799c489b-1efa10ea-9331-407b-b601-1e565ca9bb2e" released by "_create_volume_from_snapshot" :: held 6.903s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.934s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb270bb8-90d9-403e-8670-c68606b441a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efa10ea-9331-407b-b601-1e565ca9bb2e', 'volume_size': 2, 'snapshot_id': '5c23e1df-a514-445a-a54b-d5a9799c489b'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997ccc8c-bb6e-4548-8358-9c1e3cad7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:07 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Volume volume-1efa10ea-9331-407b-b601-1e565ca9bb2e (1efa10ea-9331-407b-b601-1e565ca9bb2e): created successfully
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997ccc8c-bb6e-4548-8358-9c1e3cad7357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (40549ad9-fb4f-419a-9981-8f6400641373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:07 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ed673a37-34c1-49bc-aefe-3f7b3dadad7c tempest-VolumesSnapshotTestJSON-537128668 None] Created volume successfully.
Nov 14 03:22:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-1efa10ea-9331-407b-b601-1e565ca9bb2e-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-1efa10ea-9331-407b-b601-1e565ca9bb2e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:08 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-1efa10ea-9331-407b-b601-1e565ca9bb2e" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-1efa10ea-9331-407b-b601-1e565ca9bb2e" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:08 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c615f3-8534-488c-875f-8b6dfe14ba2e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:08 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e
Nov 14 03:22:08 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:08 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e" returned: 0 in 0.751s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:08 devstack sudo[87371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e
Nov 14 03:22:08 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:09 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1efa10ea-9331-407b-b601-1e565ca9bb2e" returned: 0 in 0.659s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-1efa10ea-9331-407b-b601-1e565ca9bb2e" released by "delete_volume" :: held 1.451s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Created reservations ['5fe6ee4b-ce76-4cc2-9766-e2adc1c5e478', 'd7abfbfb-4818-494b-9219-4865252014fc', '713c5b00-acaf-4608-8189-b722b2ea2248', 'f05670c3-5820-413a-9fc6-2cc563ffb5da'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:09 devstack sudo[87374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:22:09 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:10 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.613s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:22:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Deleted volume successfully.
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c09e74e6-a1cd-412e-922f-1f252dcafb92 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-1efa10ea-9331-407b-b601-1e565ca9bb2e-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-5c23e1df-a514-445a-a54b-d5a9799c489b-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-5c23e1df-a514-445a-a54b-d5a9799c489b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:10 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-787bcb4d-987f-4715-a4be-4ed122da1643" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-787bcb4d-987f-4715-a4be-4ed122da1643" acquired by "delete_snapshot" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-5c23e1df-a514-445a-a54b-d5a9799c489b" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-5c23e1df-a514-445a-a54b-d5a9799c489b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Deleting offline snapshot 5c23e1df-a514-445a-a54b-d5a9799c489b of volume 787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] snapshot_file for this snap is: volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ced98c-7a81-44ed-acfd-402d88c62d0c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:10 devstack sudo[87378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b
Nov 14 03:22:10 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Flow 'volume_create_manager' (bbd54a90-449e-45e2-8d51-dc5042088286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bbbf15-0f04-4eb3-9224-2cc4f49a7008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bbbf15-0f04-4eb3-9224-2cc4f49a7008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1153239571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b769dc3-1550-498e-92b4-995eb3f844d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b86897ba77422eac4b141d2530ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:11Z,use_quota=True,user_id='74eda95c953c4e6cb17a220a2eb06f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64527336-236d-482a-b05d-4178bcc44bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64527336-236d-482a-b05d-4178bcc44bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e0d1a3-19d4-4314-9959-28a8a55e1ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e0d1a3-19d4-4314-9959-28a8a55e1ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b769dc3-1550-498e-92b4-995eb3f844d2', 'volume_name': 'volume-9b769dc3-1550-498e-92b4-995eb3f844d2', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed273220b0>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2a163e-7ec2-48a4-b330-511f9e819ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2a163e-7ec2-48a4-b330-511f9e819ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653877d7-d583-4065-9f4b-41b499e0b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Volume 9b769dc3-1550-498e-92b4-995eb3f844d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b769dc3-1550-498e-92b4-995eb3f844d2', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed273220b0>}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Cloning 9b769dc3-1550-498e-92b4-995eb3f844d2 from image 505e4538-4930-46f5-ae28-a520ed743bcf  at location (None, None). {{(pid=80846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Nov 14 03:22:11 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b" returned: 0 in 1.003s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787bcb4d-987f-4715-a4be-4ed122da1643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7247396d-49db-4c15-88ed-f6439810dbdf]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:22:11 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Image download 20.69 MB at 20.69 MB/s
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c03269e-5942-426e-9187-e0f1a3dff8f3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:11 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643
Nov 14 03:22:11 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:11 devstack sudo[87384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD
Nov 14 03:22:11 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:12 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD" returned: 0 in 0.805s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:12 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf is fetched for user 74eda95c953c4e6cb17a220a2eb06f84. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 14 03:22:12 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643" returned: 0 in 1.044s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:12 devstack sudo[87393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b
Nov 14 03:22:12 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc6b16-0067-4de9-8cf3-e5f6f643b339]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:12 devstack sudo[87395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD
Nov 14 03:22:12 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:13 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b" returned: 0 in 0.649s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:13 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD" returned: 0 in 0.618s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1153239571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b769dc3-1550-498e-92b4-995eb3f844d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b86897ba77422eac4b141d2530ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:11Z,use_quota=True,user_id='74eda95c953c4e6cb17a220a2eb06f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Creating volume 9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:22:13 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:13 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b
Nov 14 03:22:13 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:13 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 1073741824
Nov 14 03:22:13 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:13 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643.5c23e1df-a514-445a-a54b-d5a9799c489b" returned: 0 in 0.590s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-5c23e1df-a514-445a-a54b-d5a9799c489b" released by "_delete_snapshot" :: held 3.369s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-787bcb4d-987f-4715-a4be-4ed122da1643" released by "delete_snapshot" :: held 3.390s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Created reservations ['61d96f48-0cec-443a-8015-19a4cdc569be', '01ada398-783c-453a-9c6a-2665e91aa610', '335d3eee-b06a-4f83-9f09-dc1eb8426c4c', 'c70970ce-62c2-44c6-8a14-124807a5babb'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:22:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Delete snapshot completed successfully.
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2de3020c-4e28-4c9f-88e8-6c44151858fb tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-5c23e1df-a514-445a-a54b-d5a9799c489b-delete_snapshot" released by "delete_snapshot" :: held 3.501s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:13 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 1073741824" returned: 0 in 0.788s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:13 devstack sudo[87427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:22:13 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:14 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Attempting download of 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 9b769dc3-1550-498e-92b4-995eb3f844d2. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[20746924-06f9-41c1-b6bb-32d73f2b62a3]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_27mrk2gd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:14 devstack sudo[87430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_27mrk2gd
Nov 14 03:22:14 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-787bcb4d-987f-4715-a4be-4ed122da1643-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-787bcb4d-987f-4715-a4be-4ed122da1643-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-787bcb4d-987f-4715-a4be-4ed122da1643" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-787bcb4d-987f-4715-a4be-4ed122da1643" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a8fc0-806f-4843-98e4-b1e696fe0368]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:14 devstack sudo[87432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643
Nov 14 03:22:14 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:15 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_27mrk2gd" returned: 0 in 0.702s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_27mrk2gd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:15 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_27mrk2gd
Nov 14 03:22:15 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:15 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643" returned: 0 in 0.599s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:15 devstack sudo[87442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643
Nov 14 03:22:15 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:15 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_27mrk2gd" returned: 1 in 0.557s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_27mrk2gd' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56c9585-3efb-45c3-8c9b-96aefabc7510]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:15 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD
Nov 14 03:22:15 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:15 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-787bcb4d-987f-4715-a4be-4ed122da1643" returned: 0 in 0.539s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-787bcb4d-987f-4715-a4be-4ed122da1643" released by "delete_volume" :: held 1.186s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Created reservations ['b90748dc-ffbf-4ee5-9efa-a71374b15d54', '118afcff-9238-4c10-84c4-213896087b5e', 'ad5238e2-c307-4ae7-81b9-fcb07a2e7315', 'ea09e5d2-474b-4569-b131-076cead2f03c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:16 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:22:16 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:16 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD" returned: 0 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] 505e4538-4930-46f5-ae28-a520ed743bcf was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:16 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:22:16 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:16 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:22:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Deleted volume successfully.
Nov 14 03:22:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6850c710-112b-42ae-bf14-51e6588937f4 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-787bcb4d-987f-4715-a4be-4ed122da1643-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:17 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (c9cbed91-2c65-47b6-bc93-dc9383da5563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51384e23-5a85-4560-89b1-e6f4456f1b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51384e23-5a85-4560-89b1-e6f4456f1b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1739396236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611d05f1-a34d-4a0f-9058-eb28eb599966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82f94d3f3e4e40b296df88c4b04267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:17Z,use_quota=True,user_id='edb26d6cde9d4a07bdd7b5ef8d05ce83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0a32a8-320d-4d5b-93fb-fce47d4348d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0a32a8-320d-4d5b-93fb-fce47d4348d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4533155-da37-499b-ab2d-565a896df8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4533155-da37-499b-ab2d-565a896df8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611d05f1-a34d-4a0f-9058-eb28eb599966', 'volume_name': 'volume-611d05f1-a34d-4a0f-9058-eb28eb599966', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d186cfe-3515-489b-89ab-674365f57645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d186cfe-3515-489b-89ab-674365f57645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2f76e1-0e30-43c2-9095-4569cee3fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:17 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Volume 611d05f1-a34d-4a0f-9058-eb28eb599966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611d05f1-a34d-4a0f-9058-eb28eb599966', 'volume_size': 1}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1739396236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611d05f1-a34d-4a0f-9058-eb28eb599966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82f94d3f3e4e40b296df88c4b04267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:17Z,use_quota=True,user_id='edb26d6cde9d4a07bdd7b5ef8d05ce83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Creating volume 611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:22:17 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:17 devstack sudo[87465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 1073741824
Nov 14 03:22:17 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:17 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 0 in 1.156s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_wfp2zik3devstack@QuobyteHD, size 112.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:22:17 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Converted 112.00 MB image at 96.76 MB/s
Nov 14 03:22:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:17 devstack sudo[87470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 1G
Nov 14 03:22:17 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:18 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 1073741824" returned: 0 in 1.381s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:18 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 1G" returned: 0 in 1.296s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:18 devstack sudo[87570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966
Nov 14 03:22:18 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a72cdf-0d69-4e18-a17e-9a8c4fdb1510]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:19 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:22:19 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:19 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966" returned: 0 in 0.544s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2f76e1-0e30-43c2-9095-4569cee3fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611d05f1-a34d-4a0f-9058-eb28eb599966', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70a6aff-f7f2-4924-bfc4-dfffcd3b6d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Volume volume-611d05f1-a34d-4a0f-9058-eb28eb599966 (611d05f1-a34d-4a0f-9058-eb28eb599966): created successfully
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70a6aff-f7f2-4924-bfc4-dfffcd3b6d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (c9cbed91-2c65-47b6-bc93-dc9383da5563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0c5b7630-623f-41fd-8a45-80f17d24dcf8 tempest-VolumesSnapshotTestJSON-537128668 None] Created volume successfully.
Nov 14 03:22:19 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 0 in 0.709s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:19 devstack sudo[87577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:22:19 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:20 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 1 in 0.694s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Downloaded image 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 9b769dc3-1550-498e-92b4-995eb3f844d2 successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf for user 74eda95c953c4e6cb17a220a2eb06f84 is deleted. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Marking volume 9b769dc3-1550-498e-92b4-995eb3f844d2 as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Copying metadata from image 505e4538-4930-46f5-ae28-a520ed743bcf to 9b769dc3-1550-498e-92b4-995eb3f844d2. {{(pid=80846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Creating volume glance metadata for volume 9b769dc3-1550-498e-92b4-995eb3f844d2 backed by image 505e4538-4930-46f5-ae28-a520ed743bcf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653877d7-d583-4065-9f4b-41b499e0b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b769dc3-1550-498e-92b4-995eb3f844d2', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed273220b0>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa717658-c4a4-488d-a0f8-1f6f9565e08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:20 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Volume volume-9b769dc3-1550-498e-92b4-995eb3f844d2 (9b769dc3-1550-498e-92b4-995eb3f844d2): created successfully
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa717658-c4a4-488d-a0f8-1f6f9565e08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Flow 'volume_create_manager' (bbd54a90-449e-45e2-8d51-dc5042088286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:20 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-47d42fa3-cb8b-45b8-a668-07734c7fd570 tempest-TaggedBootDevicesTest-436784552 None] Created volume successfully.
Nov 14 03:22:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Creating offline snapshot cc940d53-a05a-45f8-bec2-254167f9a717 of volume 611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e2dbfb-2f16-42ee-b3f2-4f695def663e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:21 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Flow 'volume_create_manager' (6d717693-4f19-417c-aee5-e0f43e6314e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa92cd48-eb8a-4361-adee-6105fb6ebf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:21 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966
Nov 14 03:22:21 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa92cd48-eb8a-4361-adee-6105fb6ebf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-541856103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dccd707-2096-4666-b89a-2dc84bceeaa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b86897ba77422eac4b141d2530ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:21Z,use_quota=True,user_id='74eda95c953c4e6cb17a220a2eb06f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b384612-703d-45e3-aa27-81f31f16db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b384612-703d-45e3-aa27-81f31f16db9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539e8b4b-f763-4902-b37d-57c874eef4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539e8b4b-f763-4902-b37d-57c874eef4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dccd707-2096-4666-b89a-2dc84bceeaa5', 'volume_name': 'volume-0dccd707-2096-4666-b89a-2dc84bceeaa5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e747ab39-f265-425a-86d1-55aafc471d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e747ab39-f265-425a-86d1-55aafc471d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cb79be-fdbb-4868-bb92-54fc2ef9a612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:21 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Volume 0dccd707-2096-4666-b89a-2dc84bceeaa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dccd707-2096-4666-b89a-2dc84bceeaa5', 'volume_size': 1}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:21 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966" returned: 0 in 0.863s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:21 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 1G
Nov 14 03:22:21 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:22 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 1G" returned: 0 in 0.604s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611d05f1-a34d-4a0f-9058-eb28eb599966 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:22 devstack sudo[87595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611d05f1-a34d-4a0f-9058-eb28eb599966 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717
Nov 14 03:22:22 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:23 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611d05f1-a34d-4a0f-9058-eb28eb599966 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:23 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 is being set with open permissions: ugo+rw
Nov 14 03:22:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:23 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717
Nov 14 03:22:23 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:23 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717" returned: 0 in 0.509s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:23 devstack sudo[87603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.info
Nov 14 03:22:23 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:24 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.info" returned: 0 in 0.471s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:24 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.info is being set with open permissions: ugo+rw
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:24 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.info
Nov 14 03:22:24 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:24 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.info" returned: 0 in 0.487s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.605s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.148s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-541856103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dccd707-2096-4666-b89a-2dc84bceeaa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b86897ba77422eac4b141d2530ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:21Z,use_quota=True,user_id='74eda95c953c4e6cb17a220a2eb06f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Creating volume 0dccd707-2096-4666-b89a-2dc84bceeaa5 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:22:24 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:22:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:24 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5 1073741824
Nov 14 03:22:24 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:24 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9312bcf4-a7b4-4d62-a7ed-1583e5154f39 tempest-VolumesSnapshotTestJSON-537128668 None] Create snapshot completed successfully
Nov 14 03:22:25 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5 1073741824" returned: 0 in 0.620s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:25 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5
Nov 14 03:22:25 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (579f3c23-2d34-49ff-86b5-d3c8439d1b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03fffe6-9df4-4f37-84b4-2c6a751f3685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03fffe6-9df4-4f37-84b4-2c6a751f3685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1169937236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251479a1-22c1-4d9a-bedc-cc09bdd514a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82f94d3f3e4e40b296df88c4b04267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc940d53-a05a-45f8-bec2-254167f9a717,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:25Z,use_quota=True,user_id='edb26d6cde9d4a07bdd7b5ef8d05ce83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f40366-8ad9-470a-a156-e60ed10697f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f40366-8ad9-470a-a156-e60ed10697f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f24d3-d07b-445c-a068-fd746e3f334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f24d3-d07b-445c-a068-fd746e3f334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '251479a1-22c1-4d9a-bedc-cc09bdd514a3', 'volume_name': 'volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3', 'volume_size': 1, 'snapshot_id': 'cc940d53-a05a-45f8-bec2-254167f9a717'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf48d2a9-0a05-4fb1-974f-28b4658783ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf48d2a9-0a05-4fb1-974f-28b4658783ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2049d232-98d9-4fba-ad39-b5a932db3bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:25 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Volume 251479a1-22c1-4d9a-bedc-cc09bdd514a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3', 'volume_size': 1, 'snapshot_id': 'cc940d53-a05a-45f8-bec2-254167f9a717'}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:25 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5" returned: 0 in 0.483s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.133s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-cc940d53-a05a-45f8-bec2-254167f9a717-251479a1-22c1-4d9a-bedc-cc09bdd514a3" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cb79be-fdbb-4868-bb92-54fc2ef9a612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dccd707-2096-4666-b89a-2dc84bceeaa5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f08a40-d42b-4918-9f21-76f26f858aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-cc940d53-a05a-45f8-bec2-254167f9a717-251479a1-22c1-4d9a-bedc-cc09bdd514a3" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Creating volume 251479a1-22c1-4d9a-bedc-cc09bdd514a3 from snapshot cc940d53-a05a-45f8-bec2-254167f9a717 {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-251479a1-22c1-4d9a-bedc-cc09bdd514a3" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:25 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Volume volume-0dccd707-2096-4666-b89a-2dc84bceeaa5 (0dccd707-2096-4666-b89a-2dc84bceeaa5): created successfully
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f08a40-d42b-4918-9f21-76f26f858aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Flow 'volume_create_manager' (6d717693-4f19-417c-aee5-e0f43e6314e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-251479a1-22c1-4d9a-bedc-cc09bdd514a3" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] snapshot: cc940d53-a05a-45f8-bec2-254167f9a717, volume: 251479a1-22c1-4d9a-bedc-cc09bdd514a3,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:25 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2f4ed60d-9fee-4943-b71e-39077cbc232f tempest-TaggedBootDevicesTest-436784552 None] Created volume successfully.
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[654707c3-09ab-4f93-82bd-c2ed6142b489]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:25 devstack sudo[87623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717
Nov 14 03:22:25 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:26 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717" returned: 0 in 0.568s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-611d05f1-a34d-4a0f-9058-eb28eb599966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9098414d-189c-486c-a4c0-13c533280166]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:26 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966
Nov 14 03:22:26 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Flow 'volume_create_manager' (ef14e78e-5f95-4589-a391-0a975414ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b92b67-b865-4bea-842b-9a0260ec7bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b92b67-b865-4bea-842b-9a0260ec7bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-208705149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aab2b3b-dc02-4923-b9f9-caedbcc13365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b86897ba77422eac4b141d2530ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:27Z,use_quota=True,user_id='74eda95c953c4e6cb17a220a2eb06f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8501d7-1aeb-408b-a524-3d47a3bd0258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8501d7-1aeb-408b-a524-3d47a3bd0258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed0d9e1-d557-4311-b348-2c4cd4e16c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed0d9e1-d557-4311-b348-2c4cd4e16c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aab2b3b-dc02-4923-b9f9-caedbcc13365', 'volume_name': 'volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885adbda-27ab-4d3a-8d2f-6ec6553f1f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:26 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885adbda-27ab-4d3a-8d2f-6ec6553f1f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a356bd5d-094b-4057-8951-ec1648afe251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:26 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Volume 9aab2b3b-dc02-4923-b9f9-caedbcc13365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365', 'volume_size': 1}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966" returned: 0 in 0.583s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3 not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:22:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:26 devstack sudo[87633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3
Nov 14 03:22:26 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:29 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3" returned: 0 in 2.747s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:29 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86de12b-4aa9-4892-b04d-91afbaaff104]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:29 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966
Nov 14 03:22:29 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:30 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966" returned: 0 in 0.684s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966, size 1024.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:22:30 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Converted 1024.00 MB image at 372.60 MB/s
Nov 14 03:22:30 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3 is being set with open permissions: ugo+rw
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:30 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3
Nov 14 03:22:30 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:30 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3" returned: 0 in 0.455s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-251479a1-22c1-4d9a-bedc-cc09bdd514a3" released by "_copy_volume_from_snapshot" :: held 5.113s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-cc940d53-a05a-45f8-bec2-254167f9a717-251479a1-22c1-4d9a-bedc-cc09bdd514a3" released by "_create_volume_from_snapshot" :: held 5.145s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.166s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.914s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-208705149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aab2b3b-dc02-4923-b9f9-caedbcc13365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b86897ba77422eac4b141d2530ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:22:27Z,use_quota=True,user_id='74eda95c953c4e6cb17a220a2eb06f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Creating volume 9aab2b3b-dc02-4923-b9f9-caedbcc13365 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:22:30 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:30 devstack sudo[87657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365 1073741824
Nov 14 03:22:30 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2049d232-98d9-4fba-ad39-b5a932db3bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3', 'volume_size': 1, 'snapshot_id': 'cc940d53-a05a-45f8-bec2-254167f9a717'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86f30a5-aa75-4f62-bdae-0830ebecc417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:30 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Volume volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3 (251479a1-22c1-4d9a-bedc-cc09bdd514a3): created successfully
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86f30a5-aa75-4f62-bdae-0830ebecc417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Flow 'volume_create_manager' (579f3c23-2d34-49ff-86b5-d3c8439d1b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:30 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5fa23cba-5029-44bc-9e95-780dbcc13588 tempest-VolumesSnapshotTestJSON-537128668 None] Created volume successfully.
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-251479a1-22c1-4d9a-bedc-cc09bdd514a3-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-251479a1-22c1-4d9a-bedc-cc09bdd514a3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:31 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-251479a1-22c1-4d9a-bedc-cc09bdd514a3" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-251479a1-22c1-4d9a-bedc-cc09bdd514a3" acquired by "delete_volume" :: waited 0.027s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbceace-607c-488b-b42f-920c52369bf7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:31 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3
Nov 14 03:22:31 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:31 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365 1073741824" returned: 0 in 0.767s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:31 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365
Nov 14 03:22:31 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:31 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3" returned: 0 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:31 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3
Nov 14 03:22:31 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:32 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365" returned: 0 in 0.429s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a356bd5d-094b-4057-8951-ec1648afe251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8c7d78-6b7b-443e-894b-99fae824ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:22:32 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Volume volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365 (9aab2b3b-dc02-4923-b9f9-caedbcc13365): created successfully
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8c7d78-6b7b-443e-894b-99fae824ce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Flow 'volume_create_manager' (ef14e78e-5f95-4589-a391-0a975414ec47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:22:32 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e20cfc3d-0ada-430a-81b1-1c02ad3abe8c tempest-TaggedBootDevicesTest-436784552 None] Created volume successfully.
Nov 14 03:22:32 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-251479a1-22c1-4d9a-bedc-cc09bdd514a3" returned: 0 in 0.469s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-251479a1-22c1-4d9a-bedc-cc09bdd514a3" released by "delete_volume" :: held 1.212s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Created reservations ['d67dd593-1314-449c-b7ef-d068cbbecfc7', '15bfab58-f1a9-48c3-9193-6f4b6d146c57', '74ef4407-fc93-42ec-be88-9111ff43e43f', '13fad2dd-7e93-4bd3-ad4d-cc22ae7bc514'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:32 devstack sudo[87673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:22:32 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:33 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.623s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:22:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Deleted volume successfully.
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f96d9217-1c3c-4745-a901-6a4bdecf13e2 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-251479a1-22c1-4d9a-bedc-cc09bdd514a3-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-cc940d53-a05a-45f8-bec2-254167f9a717-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-cc940d53-a05a-45f8-bec2-254167f9a717-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-611d05f1-a34d-4a0f-9058-eb28eb599966" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-611d05f1-a34d-4a0f-9058-eb28eb599966" acquired by "delete_snapshot" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-cc940d53-a05a-45f8-bec2-254167f9a717" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-cc940d53-a05a-45f8-bec2-254167f9a717" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Deleting offline snapshot cc940d53-a05a-45f8-bec2-254167f9a717 of volume 611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] snapshot_file for this snap is: volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6bf8fc-1b2e-4536-a383-45f04fc6040c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:33 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717
Nov 14 03:22:33 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:34 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717" returned: 0 in 0.698s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-611d05f1-a34d-4a0f-9058-eb28eb599966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:22:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462e6de-1ee5-4aab-baa8-211a181f0651]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:34 devstack sudo[87681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966
Nov 14 03:22:34 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:34 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966" returned: 0 in 0.694s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:34 devstack sudo[87686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717
Nov 14 03:22:34 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:35 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717" returned: 0 in 0.531s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:35 devstack sudo[87691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717
Nov 14 03:22:35 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:35 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966.cc940d53-a05a-45f8-bec2-254167f9a717" returned: 0 in 0.630s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-cc940d53-a05a-45f8-bec2-254167f9a717" released by "_delete_snapshot" :: held 2.650s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-611d05f1-a34d-4a0f-9058-eb28eb599966" released by "delete_snapshot" :: held 2.666s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Created reservations ['d19dd9e5-6a41-401c-84bc-b1a7cd4a5ae2', 'c8a46004-9dee-4d81-a599-c17e16ed1dc5', '290b559c-fa22-40cd-9201-f05f30a39682', '78c66fb1-ea0c-4a4b-b903-08c430b31dc9'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:22:36 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Delete snapshot completed successfully.
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-dbb998b5-2e38-4265-b7e7-5725f6ec99ab tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-cc940d53-a05a-45f8-bec2-254167f9a717-delete_snapshot" released by "delete_snapshot" :: held 2.797s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-611d05f1-a34d-4a0f-9058-eb28eb599966-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-611d05f1-a34d-4a0f-9058-eb28eb599966-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:36 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-611d05f1-a34d-4a0f-9058-eb28eb599966" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-611d05f1-a34d-4a0f-9058-eb28eb599966" acquired by "delete_volume" :: waited 0.072s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a379557-a9bc-42c4-b0d3-ddd651ceaa8f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:36 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966
Nov 14 03:22:36 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:37 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966" returned: 0 in 0.710s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:37 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966
Nov 14 03:22:37 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:37 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-611d05f1-a34d-4a0f-9058-eb28eb599966" returned: 0 in 0.511s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-611d05f1-a34d-4a0f-9058-eb28eb599966" released by "delete_volume" :: held 1.276s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:37 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Created reservations ['7548ccf1-75a3-4a44-8fb8-ee7978996969', '8643e63f-e0d6-4712-a17e-e2da2b6f0729', 'f67d82f7-cffe-474d-b122-b28c0cf1fd59', '9d3d757b-d8db-4d4b-a66a-920b7d399c87'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:38 devstack sudo[87703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:22:38 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:38 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.498s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:22:38 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Deleted volume successfully.
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6b6eda8a-2cbf-45c4-bde1-680dc065cc79 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-611d05f1-a34d-4a0f-9058-eb28eb599966-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-2631f1ee-ab4a-47ac-99ec-0824d9709b8e-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-2631f1ee-ab4a-47ac-99ec-0824d9709b8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:38 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "cinder-quobyte-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:22:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:22:39 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[041f7ed0-c906-4660-9d45-1fec95f70c82]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:39 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e
Nov 14 03:22:39 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:39 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" returned: 0 in 0.615s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:39 devstack sudo[87711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e
Nov 14 03:22:39 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:40 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" returned: 0 in 0.513s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-quobyte-2631f1ee-ab4a-47ac-99ec-0824d9709b8e" released by "delete_volume" :: held 1.180s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Created reservations ['aa813a6c-130d-4083-ada5-a92998dc6607', '9e37f1f8-5a78-4e9a-8969-3a772f02aec4', '627ed0ac-bf74-4510-8f6d-22fdcb3020f2', '4fee8fa7-e8bb-43da-bed7-bccc1dd6ec7c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:40 devstack sudo[87716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:22:40 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:41 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.730s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:41 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:22:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Deleted volume successfully.
Nov 14 03:22:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d9a4641c-3cf5-4af7-9e32-7f23884af029 tempest-VolumesSnapshotTestJSON-537128668 None] Lock "cinder-2631f1ee-ab4a-47ac-99ec-0824d9709b8e-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:22:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a903295-da33-4c39-bbf4-20d2ce8efc34]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:48 devstack sudo[88024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:22:48 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:49 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 0 in 1.268s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:50 devstack sudo[88117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:22:50 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:50 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 1 in 0.734s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:22:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.040s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-9b769dc3-1550-498e-92b4-995eb3f844d2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a2a7865-0f15-487f-b5fe-292af4d6fc77', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:22:50 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:50 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-e45120eb-3841-477b-9534-c5248fbdc224 tempest-TaggedBootDevicesTest-436784552 None] attachment_update completed successfully.
Nov 14 03:22:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-00c6ad1c-9d48-4a9a-ad40-29882cabcce2 tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-00c6ad1c-9d48-4a9a-ad40-29882cabcce2 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2189a45-f520-4aee-9a43-633cc7183cf3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-00c6ad1c-9d48-4a9a-ad40-29882cabcce2 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:52 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5
Nov 14 03:22:52 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:53 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-00c6ad1c-9d48-4a9a-ad40-29882cabcce2 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5" returned: 0 in 0.899s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-00c6ad1c-9d48-4a9a-ad40-29882cabcce2 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-00c6ad1c-9d48-4a9a-ad40-29882cabcce2 tempest-TaggedBootDevicesTest-436784552 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-0dccd707-2096-4666-b89a-2dc84bceeaa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5521d95b-d7f2-4660-a80c-534edd10019b', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:22:53 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-00c6ad1c-9d48-4a9a-ad40-29882cabcce2 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-00c6ad1c-9d48-4a9a-ad40-29882cabcce2 tempest-TaggedBootDevicesTest-436784552 None] attachment_update completed successfully.
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:54 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:22:54 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:54 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.609s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=69,cinder:UPDATE=65,cinder:DELETE=7,cinder:INSERT=19 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=62,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=22 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-30b1910c-0c0a-4c82-87bc-922a05ac4524 tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-30b1910c-0c0a-4c82-87bc-922a05ac4524 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[852ee799-5e7b-47ab-8c54-6a2a90debf5b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:22:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-30b1910c-0c0a-4c82-87bc-922a05ac4524 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:22:54 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365
Nov 14 03:22:54 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:22:55 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Nov 14 03:22:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-30b1910c-0c0a-4c82-87bc-922a05ac4524 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365" returned: 0 in 0.690s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:22:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-30b1910c-0c0a-4c82-87bc-922a05ac4524 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.703s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:22:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-30b1910c-0c0a-4c82-87bc-922a05ac4524 tempest-TaggedBootDevicesTest-436784552 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbd487f5-e5bf-41c3-b039-5fdb767ce8f7', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:22:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-30b1910c-0c0a-4c82-87bc-922a05ac4524 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:22:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-2c94c6c0-7e60-46c4-815b-2439f6ba36a9 req-30b1910c-0c0a-4c82-87bc-922a05ac4524 tempest-TaggedBootDevicesTest-436784552 None] attachment_update completed successfully.
Nov 14 03:23:01 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-c28377d9-016a-466d-9e8e-08df387bb109 req-8c5d1c10-b560-45e3-8902-0cde961ebb60 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:01 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-c28377d9-016a-466d-9e8e-08df387bb109 req-8c5d1c10-b560-45e3-8902-0cde961ebb60 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-c28377d9-016a-466d-9e8e-08df387bb109 req-8c5d1c10-b560-45e3-8902-0cde961ebb60 tempest-TaggedBootDevicesTest_v242-354891865 None] Terminate volume connection completed successfully.
Nov 14 03:23:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-c28377d9-016a-466d-9e8e-08df387bb109 req-8c5d1c10-b560-45e3-8902-0cde961ebb60 tempest-TaggedBootDevicesTest_v242-354891865 None] Deleting attachment f9ef8f53-0416-4e89-aeeb-ff49cf60edc5. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:23:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-c28377d9-016a-466d-9e8e-08df387bb109 req-88d632b8-becd-4e49-9cd5-d8c56b832887 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-c28377d9-016a-466d-9e8e-08df387bb109 req-88d632b8-becd-4e49-9cd5-d8c56b832887 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-c28377d9-016a-466d-9e8e-08df387bb109 req-88d632b8-becd-4e49-9cd5-d8c56b832887 tempest-TaggedBootDevicesTest_v242-354891865 None] Terminate volume connection completed successfully.
Nov 14 03:23:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-c28377d9-016a-466d-9e8e-08df387bb109 req-88d632b8-becd-4e49-9cd5-d8c56b832887 tempest-TaggedBootDevicesTest_v242-354891865 None] Deleting attachment 01065077-e9ca-4bba-a53b-fc94ed5d93f9. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:23:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-c28377d9-016a-466d-9e8e-08df387bb109 req-f7f4d0ea-ab85-45cd-bae7-5fd4eb1e3901 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-c28377d9-016a-466d-9e8e-08df387bb109 req-f7f4d0ea-ab85-45cd-bae7-5fd4eb1e3901 tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-c28377d9-016a-466d-9e8e-08df387bb109 req-f7f4d0ea-ab85-45cd-bae7-5fd4eb1e3901 tempest-TaggedBootDevicesTest_v242-354891865 None] Terminate volume connection completed successfully.
Nov 14 03:23:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-c28377d9-016a-466d-9e8e-08df387bb109 req-f7f4d0ea-ab85-45cd-bae7-5fd4eb1e3901 tempest-TaggedBootDevicesTest_v242-354891865 None] Deleting attachment ec46b3b2-fd2e-45cc-abb0-eecda0a851c1. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "cinder-0928274a-ec39-4300-a210-81a14cab8a89-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-0928274a-ec39-4300-a210-81a14cab8a89-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:23:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "cinder-quobyte-0928274a-ec39-4300-a210-81a14cab8a89" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-quobyte-0928274a-ec39-4300-a210-81a14cab8a89" acquired by "delete_volume" :: waited 0.036s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:23:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Flow 'volume_create_manager' (e08c60c5-71c9-4bf1-9ddc-d3a97c8d098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d3968f-9f7f-489e-a245-634f7a99ea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e3d81c-b8b1-4f6b-a301-a5a695eb3ca1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d3968f-9f7f-489e-a245-634f7a99ea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-462051387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d521c1-5663-4149-99bf-e98b84d235e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8854726432d42eb9d998005a8a1a53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:23:12Z,use_quota=True,user_id='4f4081006b6e43b9b6f9bb66acaf8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c84f699f-2d35-4d3c-b48a-9379c76318c0),volume_type_id=c84f699f-2d35-4d3c-b48a-9379c76318c0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a68d3f-bfca-439a-87d1-5cfd35a81d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a68d3f-bfca-439a-87d1-5cfd35a81d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d4f316-51a6-416a-aaac-764a92048e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d4f316-51a6-416a-aaac-764a92048e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d521c1-5663-4149-99bf-e98b84d235e8', 'volume_name': 'volume-36d521c1-5663-4149-99bf-e98b84d235e8', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fda1bbd-32d8-4959-b6a0-2e8542273f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fda1bbd-32d8-4959-b6a0-2e8542273f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7396af-1327-44af-81b3-aeda4f4811f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume 36d521c1-5663-4149-99bf-e98b84d235e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d521c1-5663-4149-99bf-e98b84d235e8', 'volume_size': 1}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-462051387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d521c1-5663-4149-99bf-e98b84d235e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8854726432d42eb9d998005a8a1a53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:23:12Z,use_quota=True,user_id='4f4081006b6e43b9b6f9bb66acaf8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c84f699f-2d35-4d3c-b48a-9379c76318c0),volume_type_id=c84f699f-2d35-4d3c-b48a-9379c76318c0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Creating volume 36d521c1-5663-4149-99bf-e98b84d235e8 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:23:11 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:11 devstack sudo[88201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8 1073741824
Nov 14 03:23:11 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Flow 'volume_create_manager' (80e16f03-6140-46dc-afb4-2e742ccc519a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902f1b54-ee3d-4948-b7c5-9dc4a0859862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902f1b54-ee3d-4948-b7c5-9dc4a0859862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-558316917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd06498-5ed6-4718-8af6-ca7244272168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8854726432d42eb9d998005a8a1a53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:23:12Z,use_quota=True,user_id='4f4081006b6e43b9b6f9bb66acaf8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17eabb1f-bc3c-45c3-876d-ad7aef40f415),volume_type_id=17eabb1f-bc3c-45c3-876d-ad7aef40f415)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9b19c9-48bb-4bf1-8e59-ec18a5c717f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9b19c9-48bb-4bf1-8e59-ec18a5c717f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb64d19-2ba2-43a1-b9f1-2762214199d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb64d19-2ba2-43a1-b9f1-2762214199d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd06498-5ed6-4718-8af6-ca7244272168', 'volume_name': 'volume-5fd06498-5ed6-4718-8af6-ca7244272168', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dde9ca7-b2cc-4e8e-b24c-9652385d0b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dde9ca7-b2cc-4e8e-b24c-9652385d0b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:11 devstack sudo[88200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89
Nov 14 03:23:11 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bed7150-7952-4070-892b-500faefed52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume 5fd06498-5ed6-4718-8af6-ca7244272168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd06498-5ed6-4718-8af6-ca7244272168', 'volume_size': 1}
Nov 14 03:23:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Flow 'volume_create_manager' (66fbcf87-6ecb-4f1d-8148-301c2577d5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e717e4c7-6d1b-4f56-ac42-63e02b77dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e717e4c7-6d1b-4f56-ac42-63e02b77dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1834202116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8854726432d42eb9d998005a8a1a53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:23:12Z,use_quota=True,user_id='4f4081006b6e43b9b6f9bb66acaf8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7afc599a-4d5f-4839-9a40-c537fe44732c),volume_type_id=7afc599a-4d5f-4839-9a40-c537fe44732c)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38c2f28-f524-41b1-b538-d33a77d28276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38c2f28-f524-41b1-b538-d33a77d28276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695f9a91-b2a3-4b39-b03b-65c462901b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695f9a91-b2a3-4b39-b03b-65c462901b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba', 'volume_name': 'volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba', 'volume_size': 1, 'image_id': '98158bc6-74f0-4126-960d-4275597d69de', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--793542308', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8854726432d42eb9d998005a8a1a53a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98158bc6-74f0-4126-960d-4275597d69de', 'created_at': datetime.datetime(2025, 11, 14, 2, 23, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 23, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98158bc6-74f0-4126-960d-4275597d69de/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26c1acb0>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533e3344-e030-4f8e-8acd-badf24bfb2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533e3344-e030-4f8e-8acd-badf24bfb2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6304ee15-f4c6-4cad-94f5-545808305b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume 7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba', 'volume_size': 1, 'image_id': '98158bc6-74f0-4126-960d-4275597d69de', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--793542308', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8854726432d42eb9d998005a8a1a53a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98158bc6-74f0-4126-960d-4275597d69de', 'created_at': datetime.datetime(2025, 11, 14, 2, 23, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 23, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98158bc6-74f0-4126-960d-4275597d69de/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26c1acb0>}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Cloning 7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba from image 98158bc6-74f0-4126-960d-4275597d69de  at location (None, None). {{(pid=80846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Nov 14 03:23:12 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8 1073741824" returned: 0 in 1.078s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:12 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8
Nov 14 03:23:12 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:12 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89" returned: 0 in 1.298s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:13 devstack sudo[88212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89
Nov 14 03:23:13 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:13 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8" returned: 0 in 0.635s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-558316917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd06498-5ed6-4718-8af6-ca7244272168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8854726432d42eb9d998005a8a1a53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:23:12Z,use_quota=True,user_id='4f4081006b6e43b9b6f9bb66acaf8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17eabb1f-bc3c-45c3-876d-ad7aef40f415),volume_type_id=17eabb1f-bc3c-45c3-876d-ad7aef40f415)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Creating volume 5fd06498-5ed6-4718-8af6-ca7244272168 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:23:13 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7396af-1327-44af-81b3-aeda4f4811f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d521c1-5663-4149-99bf-e98b84d235e8', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e70343-3801-4e18-9306-f5104ee9c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:13 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168 1073741824
Nov 14 03:23:13 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume volume-36d521c1-5663-4149-99bf-e98b84d235e8 (36d521c1-5663-4149-99bf-e98b84d235e8): created successfully
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e70343-3801-4e18-9306-f5104ee9c576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Flow 'volume_create_manager' (e08c60c5-71c9-4bf1-9ddc-d3a97c8d098f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:23:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3d4e9828-a7dd-48e1-972d-ee9d17f4eac1 tempest-TestInstancesWithCinderVolumes-284758692 None] Created volume successfully.
Nov 14 03:23:13 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0928274a-ec39-4300-a210-81a14cab8a89" returned: 0 in 0.712s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-quobyte-0928274a-ec39-4300-a210-81a14cab8a89" released by "delete_volume" :: held 2.076s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Created reservations ['08431453-01d5-4a63-b4f5-0eff0c06c8e7', 'e87eea4e-86cd-472b-ad40-05b9ed3229b7', 'c939eaf4-b6eb-43d5-bd4c-6ba9cf57802d', 'a50450c0-e43e-4978-8227-ea7ee381dde2'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:13 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:23:13 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "cinder-c4716f97-dec5-4742-b178-d3f6e9699f53-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-c4716f97-dec5-4742-b178-d3f6e9699f53-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:23:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "cinder-quobyte-c4716f97-dec5-4742-b178-d3f6e9699f53" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-quobyte-c4716f97-dec5-4742-b178-d3f6e9699f53" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d81e94d-60cb-4b21-b131-bd28bc45afa1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD, size 20.69 MB, duration 1.70 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:23:14 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Image download 20.69 MB at 12.16 MB/s
Nov 14 03:23:14 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53
Nov 14 03:23:14 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc8ea5-0da0-471d-a769-f2758710fdcd]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:14 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD
Nov 14 03:23:14 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:14 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168 1073741824" returned: 0 in 1.138s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:14 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168
Nov 14 03:23:14 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:14 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.933s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:23:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Deleted volume successfully.
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c9af917d-1033-49a6-a896-5b4c3111b15e tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-0928274a-ec39-4300-a210-81a14cab8a89-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:23:14 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53" returned: 0 in 0.990s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:14 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53
Nov 14 03:23:14 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:15 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD" returned: 0 in 0.800s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Temporary image 98158bc6-74f0-4126-960d-4275597d69de is fetched for user 4f4081006b6e43b9b6f9bb66acaf8f7a. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[798cab08-eeba-47b0-bb65-9c75dec5700a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:15 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168" returned: 0 in 0.688s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bed7150-7952-4070-892b-500faefed52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd06498-5ed6-4718-8af6-ca7244272168', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f57365-0100-430c-9007-165dcd8e4ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:15 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume volume-5fd06498-5ed6-4718-8af6-ca7244272168 (5fd06498-5ed6-4718-8af6-ca7244272168): created successfully
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f57365-0100-430c-9007-165dcd8e4ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Flow 'volume_create_manager' (80e16f03-6140-46dc-afb4-2e742ccc519a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:23:15 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-84482c96-7d7a-428f-96f4-0596e152bf16 tempest-TestInstancesWithCinderVolumes-284758692 None] Created volume successfully.
Nov 14 03:23:15 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD
Nov 14 03:23:15 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:15 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c4716f97-dec5-4742-b178-d3f6e9699f53" returned: 0 in 0.821s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-quobyte-c4716f97-dec5-4742-b178-d3f6e9699f53" released by "delete_volume" :: held 1.834s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Created reservations ['e07e7468-e78d-4217-b28b-30901453993d', 'fb760bcc-3ccc-466e-876a-7918eefb490b', '5ad0c1ad-776b-4e22-9b45-04c07c1cd4ea', '68dfe72c-d6de-43de-b467-8d75d947a9fa'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:15 devstack sudo[88313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:23:15 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:15 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD" returned: 0 in 0.737s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1834202116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8854726432d42eb9d998005a8a1a53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:23:12Z,use_quota=True,user_id='4f4081006b6e43b9b6f9bb66acaf8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7afc599a-4d5f-4839-9a40-c537fe44732c),volume_type_id=7afc599a-4d5f-4839-9a40-c537fe44732c)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Creating volume 7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:23:15 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:23:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:16 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba 1073741824
Nov 14 03:23:16 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "cinder-5424b32d-b747-4f02-bbb1-29f080aea40b-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-5424b32d-b747-4f02-bbb1-29f080aea40b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:23:16 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "cinder-quobyte-5424b32d-b747-4f02-bbb1-29f080aea40b" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-quobyte-5424b32d-b747-4f02-bbb1-29f080aea40b" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fce70d2-216d-4cd9-ae0b-547a21181653]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:16 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:23:16 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:16 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.566s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:23:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Deleted volume successfully.
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a0ac9ec3-2eb8-4b70-996f-35bab11bffdd tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-c4716f97-dec5-4742-b178-d3f6e9699f53-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:23:16 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba 1073741824" returned: 0 in 0.667s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:16 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:23:16 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:16 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 0 in 0.621s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:17 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:23:17 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:17 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 0 in 0.477s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Attempting download of 98158bc6-74f0-4126-960d-4275597d69de ((None, None)) to volume 7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6977fb15-e18c-41fa-b7df-17d94af1cab3]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98158bc6-74f0-4126-960d-4275597d69de_l5wxh60d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:17 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98158bc6-74f0-4126-960d-4275597d69de_l5wxh60d
Nov 14 03:23:17 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:17 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 1 in 0.595s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:17 devstack sudo[88396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b
Nov 14 03:23:17 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:17 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98158bc6-74f0-4126-960d-4275597d69de_l5wxh60d" returned: 0 in 0.611s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98158bc6-74f0-4126-960d-4275597d69de_l5wxh60d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:17 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98158bc6-74f0-4126-960d-4275597d69de_l5wxh60d
Nov 14 03:23:17 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:17 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5424b32d-b747-4f02-bbb1-29f080aea40b" returned: 0 in 0.457s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-quobyte-5424b32d-b747-4f02-bbb1-29f080aea40b" released by "delete_volume" :: held 1.715s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:23:17 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Created reservations ['8fd70424-b28d-4ffc-a410-43e4ef1815a6', '5740eb18-1685-4af1-8443-33c78343ff2b', '35efe1ff-1ac0-4422-a887-179aed2bfaa2', '3527183b-693f-413a-8af6-fcb805d6b1e7'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:18 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:23:18 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:18 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98158bc6-74f0-4126-960d-4275597d69de_l5wxh60d" returned: 1 in 0.621s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98158bc6-74f0-4126-960d-4275597d69de_l5wxh60d' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16d05fb-6189-417f-8414-618b0d7a40b8]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:18 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.488s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:23:18 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Deleted volume successfully.
Nov 14 03:23:18 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD
Nov 14 03:23:18 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5975f002-9f09-4218-9f72-a3b29a6d3fbb tempest-TaggedBootDevicesTest_v242-354891865 None] Lock "cinder-5424b32d-b747-4f02-bbb1-29f080aea40b-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:23:19 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD" returned: 0 in 0.658s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:19 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] 98158bc6-74f0-4126-960d-4275597d69de was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:23:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:19 devstack sudo[88488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:23:19 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:20 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 0 in 1.475s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:20 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_98158bc6-74f0-4126-960d-4275597d69de_8nd50cj3devstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:23:20 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Converted 112.00 MB image at 75.87 MB/s
Nov 14 03:23:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:20 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba 1G
Nov 14 03:23:20 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:21 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba 1G" returned: 0 in 1.092s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aed729-df2d-4610-89cd-cebc19db8f94]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:21 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:23:21 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:22 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 0 in 1.021s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:22 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:23:22 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:23 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 1 in 0.767s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Downloaded image 98158bc6-74f0-4126-960d-4275597d69de ((None, None)) to volume 7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Temporary image 98158bc6-74f0-4126-960d-4275597d69de for user 4f4081006b6e43b9b6f9bb66acaf8f7a is deleted. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Marking volume 7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Copying metadata from image 98158bc6-74f0-4126-960d-4275597d69de to 7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba. {{(pid=80846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Creating volume glance metadata for volume 7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba backed by image 98158bc6-74f0-4126-960d-4275597d69de with: {'image_id': '98158bc6-74f0-4126-960d-4275597d69de', 'image_name': 'tempest-scenario-img--793542308', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6304ee15-f4c6-4cad-94f5-545808305b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba', 'volume_size': 1, 'image_id': '98158bc6-74f0-4126-960d-4275597d69de', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--793542308', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8854726432d42eb9d998005a8a1a53a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98158bc6-74f0-4126-960d-4275597d69de', 'created_at': datetime.datetime(2025, 11, 14, 2, 23, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 23, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98158bc6-74f0-4126-960d-4275597d69de/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26c1acb0>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d3460-45af-4f2a-bca8-bfc0ec826699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:23 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba (7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba): created successfully
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d3460-45af-4f2a-bca8-bfc0ec826699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Flow 'volume_create_manager' (66fbcf87-6ecb-4f1d-8148-301c2577d5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:23:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5ecba62a-be9c-4dc4-b92f-f9075ef17a77 tempest-TestInstancesWithCinderVolumes-284758692 None] Created volume successfully.
Nov 14 03:23:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Flow 'volume_create_manager' (e6222951-a9f9-4c47-9b48-acf49bb0ae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5695fdd-3752-4348-b353-28ab74d63282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5695fdd-3752-4348-b353-28ab74d63282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-322708365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262fb367-b28f-443c-b6b0-7e89d118fd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0062f4234b4a139a1f5cd353756fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:23:24Z,use_quota=True,user_id='c4685012846f44e2a9ae537c2280b867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540c691c-cef3-4250-bb3d-f1eea17b16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540c691c-cef3-4250-bb3d-f1eea17b16cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff1a0a9-df61-4446-88cb-e86b8aeb2c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff1a0a9-df61-4446-88cb-e86b8aeb2c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262fb367-b28f-443c-b6b0-7e89d118fd9a', 'volume_name': 'volume-262fb367-b28f-443c-b6b0-7e89d118fd9a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b0467f-c670-466c-ac41-6f8978ad9603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b0467f-c670-466c-ac41-6f8978ad9603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106190f1-82cc-4319-9255-f7001f0e626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:24 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Volume 262fb367-b28f-443c-b6b0-7e89d118fd9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262fb367-b28f-443c-b6b0-7e89d118fd9a', 'volume_size': 1}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-322708365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262fb367-b28f-443c-b6b0-7e89d118fd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0062f4234b4a139a1f5cd353756fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:23:24Z,use_quota=True,user_id='c4685012846f44e2a9ae537c2280b867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Creating volume 262fb367-b28f-443c-b6b0-7e89d118fd9a {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:23:24 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:23:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:24 devstack sudo[89039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a 1073741824
Nov 14 03:23:24 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:25 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a 1073741824" returned: 0 in 0.803s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:25 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a
Nov 14 03:23:25 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:26 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a" returned: 0 in 0.669s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:23:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106190f1-82cc-4319-9255-f7001f0e626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262fb367-b28f-443c-b6b0-7e89d118fd9a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82cd73e8-8d78-4bc4-b1fe-eb6fed6c805b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:23:26 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Volume volume-262fb367-b28f-443c-b6b0-7e89d118fd9a (262fb367-b28f-443c-b6b0-7e89d118fd9a): created successfully
Nov 14 03:23:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82cd73e8-8d78-4bc4-b1fe-eb6fed6c805b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:23:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Flow 'volume_create_manager' (e6222951-a9f9-4c47-9b48-acf49bb0ae45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:23:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-46afa9f5-a333-40cb-8939-9fac39318491 tempest-AttachVolumeNegativeTest-460057857 None] Created volume successfully.
Nov 14 03:23:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-54c1b25a-f6c8-4f7d-8bb6-963b031f75d2 req-cb30a1c7-aaee-4ac8-ae31-f0b8c226dcaa tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-54c1b25a-f6c8-4f7d-8bb6-963b031f75d2 req-cb30a1c7-aaee-4ac8-ae31-f0b8c226dcaa tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:29 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25bf3dc-bba4-49c1-8bb6-542e96785e1a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-54c1b25a-f6c8-4f7d-8bb6-963b031f75d2 req-cb30a1c7-aaee-4ac8-ae31-f0b8c226dcaa tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:29 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a
Nov 14 03:23:29 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:30 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-54c1b25a-f6c8-4f7d-8bb6-963b031f75d2 req-cb30a1c7-aaee-4ac8-ae31-f0b8c226dcaa tempest-AttachVolumeNegativeTest-460057857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a" returned: 0 in 0.740s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-54c1b25a-f6c8-4f7d-8bb6-963b031f75d2 req-cb30a1c7-aaee-4ac8-ae31-f0b8c226dcaa tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.760s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-54c1b25a-f6c8-4f7d-8bb6-963b031f75d2 req-cb30a1c7-aaee-4ac8-ae31-f0b8c226dcaa tempest-AttachVolumeNegativeTest-460057857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-262fb367-b28f-443c-b6b0-7e89d118fd9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54e82bbd-f106-4000-9976-7b811fc58809', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:23:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-54c1b25a-f6c8-4f7d-8bb6-963b031f75d2 req-cb30a1c7-aaee-4ac8-ae31-f0b8c226dcaa tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:30 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-54c1b25a-f6c8-4f7d-8bb6-963b031f75d2 req-cb30a1c7-aaee-4ac8-ae31-f0b8c226dcaa tempest-AttachVolumeNegativeTest-460057857 None] attachment_update completed successfully.
Nov 14 03:23:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:31 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f1f9bb-7edc-430d-b03c-3c7a223a9b3e]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:23:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:31 devstack sudo[89086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:23:31 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:32 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 0 in 0.925s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:32 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:23:32 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:32 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 1 in 0.670s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:23:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.681s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e524756c-85d3-4074-a09c-9b6823c90c82', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:23:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:23:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-930ba174-4731-4d72-b002-94ba8a506136 req-c7cd4d85-b36f-4734-ad1d-22c47a7b6a5d tempest-TestInstancesWithCinderVolumes-284758692 None] attachment_update completed successfully.
Nov 14 03:23:43 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=46,cinder:UPDATE=30,cinder:INSERT=14,cinder:DELETE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:23:43 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=40,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=7 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:23:54 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:23:54 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:23:54 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.752s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:23:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:24:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:24:54 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:24:54 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:24:54 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.503s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:24:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:24:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-05a58725-2949-4135-a75e-11f4e2777dc9 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:24:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-05a58725-2949-4135-a75e-11f4e2777dc9 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:24:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-05a58725-2949-4135-a75e-11f4e2777dc9 tempest-TaggedBootDevicesTest-436784552 None] Terminate volume connection completed successfully.
Nov 14 03:24:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-05a58725-2949-4135-a75e-11f4e2777dc9 tempest-TaggedBootDevicesTest-436784552 None] Deleting attachment 5521d95b-d7f2-4660-a80c-534edd10019b. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:24:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-cc7f017a-fed7-4ed6-8c23-05d9f768ac40 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:24:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-cc7f017a-fed7-4ed6-8c23-05d9f768ac40 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:24:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-cc7f017a-fed7-4ed6-8c23-05d9f768ac40 tempest-TaggedBootDevicesTest-436784552 None] Terminate volume connection completed successfully.
Nov 14 03:24:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-cc7f017a-fed7-4ed6-8c23-05d9f768ac40 tempest-TaggedBootDevicesTest-436784552 None] Deleting attachment cbd487f5-e5bf-41c3-b039-5fdb767ce8f7. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:24:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-bf09b988-bfa9-4d36-ba1f-9ef5a7ae7139 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:24:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-bf09b988-bfa9-4d36-ba1f-9ef5a7ae7139 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:24:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-bf09b988-bfa9-4d36-ba1f-9ef5a7ae7139 tempest-TaggedBootDevicesTest-436784552 None] Terminate volume connection completed successfully.
Nov 14 03:24:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-46cc81f5-641f-4d2c-87f2-bd8ecd588fdb req-bf09b988-bfa9-4d36-ba1f-9ef5a7ae7139 tempest-TaggedBootDevicesTest-436784552 None] Deleting attachment 4a2a7865-0f15-487f-b5fe-292af4d6fc77. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:25:01 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Flow 'volume_create_manager' (5e08857d-fd9c-4332-be35-e872e9e49f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa20e0c2-9332-4fec-bfc3-06eb65a22751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa20e0c2-9332-4fec-bfc3-06eb65a22751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-305194458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde4656b-334f-43bb-890e-b7781e83cab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3667fbc45b4fb4b91992f93bd38f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:25:02Z,use_quota=True,user_id='1e1e1da237f44233adf44a92c6554b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125337c8-445b-46ea-b202-6a35859c6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125337c8-445b-46ea-b202-6a35859c6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ad5625-1f35-49a3-aa55-a9ed5c02f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ad5625-1f35-49a3-aa55-a9ed5c02f933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde4656b-334f-43bb-890e-b7781e83cab4', 'volume_name': 'volume-bde4656b-334f-43bb-890e-b7781e83cab4', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce708f08-a1c5-422f-9b44-f65a02304754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce708f08-a1c5-422f-9b44-f65a02304754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc66b7d-9237-4a6d-9dea-0d4c76482890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:01 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume bde4656b-334f-43bb-890e-b7781e83cab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde4656b-334f-43bb-890e-b7781e83cab4', 'volume_size': 1}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-305194458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde4656b-334f-43bb-890e-b7781e83cab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3667fbc45b4fb4b91992f93bd38f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:25:02Z,use_quota=True,user_id='1e1e1da237f44233adf44a92c6554b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Creating volume bde4656b-334f-43bb-890e-b7781e83cab4 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:25:01 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:25:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:01 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4 1073741824
Nov 14 03:25:01 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-44c71926-92d4-4bce-b0dc-898a6fc8721a req-43da6d08-54a7-480b-8f2f-481937cb2f1a tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:02 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4 1073741824" returned: 0 in 0.736s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:02 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4
Nov 14 03:25:02 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "cinder-9aab2b3b-dc02-4923-b9f9-caedbcc13365-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-9aab2b3b-dc02-4923-b9f9-caedbcc13365-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "cinder-quobyte-9aab2b3b-dc02-4923-b9f9-caedbcc13365" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-quobyte-9aab2b3b-dc02-4923-b9f9-caedbcc13365" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3c1277-8549-4933-94b2-b4f0d3964a67]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:03 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4" returned: 0 in 0.693s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-44c71926-92d4-4bce-b0dc-898a6fc8721a req-43da6d08-54a7-480b-8f2f-481937cb2f1a tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.105s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0cf075-268e-4c60-ba87-2c892e2da914]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-44c71926-92d4-4bce-b0dc-898a6fc8721a req-43da6d08-54a7-480b-8f2f-481937cb2f1a tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc66b7d-9237-4a6d-9dea-0d4c76482890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde4656b-334f-43bb-890e-b7781e83cab4', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de853e7-fbad-42b0-889a-607fcdef76b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:03 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume volume-bde4656b-334f-43bb-890e-b7781e83cab4 (bde4656b-334f-43bb-890e-b7781e83cab4): created successfully
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de853e7-fbad-42b0-889a-607fcdef76b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Flow 'volume_create_manager' (5e08857d-fd9c-4332-be35-e872e9e49f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:25:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1c7ef5ef-74dd-40da-a1df-48af151f7a17 tempest-AttachVolumeShelveTestJSON-1837662251 None] Created volume successfully.
Nov 14 03:25:03 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365
Nov 14 03:25:03 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:03 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8
Nov 14 03:25:03 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:03 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365" returned: 0 in 0.767s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:03 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365
Nov 14 03:25:03 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:04 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-44c71926-92d4-4bce-b0dc-898a6fc8721a req-43da6d08-54a7-480b-8f2f-481937cb2f1a tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8" returned: 0 in 0.769s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-44c71926-92d4-4bce-b0dc-898a6fc8721a req-43da6d08-54a7-480b-8f2f-481937cb2f1a tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.783s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-44c71926-92d4-4bce-b0dc-898a6fc8721a req-43da6d08-54a7-480b-8f2f-481937cb2f1a tempest-TestInstancesWithCinderVolumes-284758692 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-36d521c1-5663-4149-99bf-e98b84d235e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16d49805-19fc-4810-a7da-a4f2b5d64898', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:25:04 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-44c71926-92d4-4bce-b0dc-898a6fc8721a req-43da6d08-54a7-480b-8f2f-481937cb2f1a tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-44c71926-92d4-4bce-b0dc-898a6fc8721a req-43da6d08-54a7-480b-8f2f-481937cb2f1a tempest-TestInstancesWithCinderVolumes-284758692 None] attachment_update completed successfully.
Nov 14 03:25:04 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9aab2b3b-dc02-4923-b9f9-caedbcc13365" returned: 0 in 0.509s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-quobyte-9aab2b3b-dc02-4923-b9f9-caedbcc13365" released by "delete_volume" :: held 1.302s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Created reservations ['a6467e83-2f22-4a67-bbc9-a5cfff1309e1', '2a0a7661-911d-4edd-848b-d0aab801b281', 'ecbf0f34-21c1-4a7a-8430-d4373a2aac55', '85fb6b80-e49b-4576-b184-37635c077e5d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:04 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:25:04 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:05 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.666s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:25:05 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Deleted volume successfully.
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-586d7fd1-1b02-4fa2-bf3e-3595a5eedfbf tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-9aab2b3b-dc02-4923-b9f9-caedbcc13365-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "cinder-0dccd707-2096-4666-b89a-2dc84bceeaa5-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-0dccd707-2096-4666-b89a-2dc84bceeaa5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:05 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "cinder-quobyte-0dccd707-2096-4666-b89a-2dc84bceeaa5" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-quobyte-0dccd707-2096-4666-b89a-2dc84bceeaa5" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[44576061-d370-4e77-8b05-4b247abc6d78]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:05 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5
Nov 14 03:25:05 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:06 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5" returned: 0 in 0.626s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:06 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5
Nov 14 03:25:06 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:06 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dccd707-2096-4666-b89a-2dc84bceeaa5" returned: 0 in 0.449s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-quobyte-0dccd707-2096-4666-b89a-2dc84bceeaa5" released by "delete_volume" :: held 1.106s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Created reservations ['a1e21306-9398-45a8-8f00-9a313cb9a9a4', '8da627fb-2925-4a66-914b-92c2d7d9af5e', '6d70f592-592c-4db4-b701-6d6a971f664c', '4c119921-8095-4a8b-9bdd-45f9b37764fc'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:06 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:25:06 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:07 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.590s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:25:07 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Deleted volume successfully.
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12b1a62e-c982-4d70-bf28-051fc9af575c tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-0dccd707-2096-4666-b89a-2dc84bceeaa5-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "cinder-9b769dc3-1550-498e-92b4-995eb3f844d2-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-9b769dc3-1550-498e-92b4-995eb3f844d2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:07 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "cinder-quobyte-9b769dc3-1550-498e-92b4-995eb3f844d2" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-quobyte-9b769dc3-1550-498e-92b4-995eb3f844d2" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba621ca2-ca8c-4897-a41e-1d2d1acc872d]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:07 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:25:07 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:08 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 0 in 0.613s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:08 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:25:08 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:08 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 1 in 0.661s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:25:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:08 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2
Nov 14 03:25:08 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:09 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9b769dc3-1550-498e-92b4-995eb3f844d2" returned: 0 in 0.590s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-quobyte-9b769dc3-1550-498e-92b4-995eb3f844d2" released by "delete_volume" :: held 1.905s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Created reservations ['06d75bb8-6918-4cb4-80ec-9d8537a06ead', '26333a10-a171-4230-939c-b3bedbabd4a9', '9c1c52dd-538d-42dc-bfa3-8698484148d5', 'fa81c5a3-f5fe-4e81-87ec-f8db1d203793'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:09 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:25:09 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:10 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.501s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:10 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:25:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Deleted volume successfully.
Nov 14 03:25:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f8cc16d8-f951-43d0-9f67-e94b106e6d36 tempest-TaggedBootDevicesTest-436784552 None] Lock "cinder-9b769dc3-1550-498e-92b4-995eb3f844d2-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-2e5d28f6-3f6d-4377-89e2-f1b711d02d9f req-0a1e893d-3d97-44f7-beb1-5c4c3bc02925 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-2e5d28f6-3f6d-4377-89e2-f1b711d02d9f req-0a1e893d-3d97-44f7-beb1-5c4c3bc02925 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:11 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-2e5d28f6-3f6d-4377-89e2-f1b711d02d9f req-0a1e893d-3d97-44f7-beb1-5c4c3bc02925 tempest-AttachVolumeNegativeTest-460057857 None] Terminate volume connection completed successfully.
Nov 14 03:25:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-2e5d28f6-3f6d-4377-89e2-f1b711d02d9f req-0a1e893d-3d97-44f7-beb1-5c4c3bc02925 tempest-AttachVolumeNegativeTest-460057857 None] Deleting attachment 54e82bbd-f106-4000-9976-7b811fc58809. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:25:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-90d042cc-8a52-4b1a-a1de-131c4431467e req-5c4b369d-209a-4586-ad18-8c03dd0268ca tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-90d042cc-8a52-4b1a-a1de-131c4431467e req-5c4b369d-209a-4586-ad18-8c03dd0268ca tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22407ee-2fcc-485e-90bb-7ca53d13ee88]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-90d042cc-8a52-4b1a-a1de-131c4431467e req-5c4b369d-209a-4586-ad18-8c03dd0268ca tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:12 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168
Nov 14 03:25:12 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:12 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-90d042cc-8a52-4b1a-a1de-131c4431467e req-5c4b369d-209a-4586-ad18-8c03dd0268ca tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168" returned: 0 in 0.711s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-90d042cc-8a52-4b1a-a1de-131c4431467e req-5c4b369d-209a-4586-ad18-8c03dd0268ca tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.727s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-90d042cc-8a52-4b1a-a1de-131c4431467e req-5c4b369d-209a-4586-ad18-8c03dd0268ca tempest-TestInstancesWithCinderVolumes-284758692 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-5fd06498-5ed6-4718-8af6-ca7244272168', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63c9c5a6-c31c-41ee-9da0-224d0fa8e781', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:25:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-90d042cc-8a52-4b1a-a1de-131c4431467e req-5c4b369d-209a-4586-ad18-8c03dd0268ca tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:12 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-90d042cc-8a52-4b1a-a1de-131c4431467e req-5c4b369d-209a-4586-ad18-8c03dd0268ca tempest-TestInstancesWithCinderVolumes-284758692 None] attachment_update completed successfully.
Nov 14 03:25:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f59bee4c-84bf-40be-b082-4f6ad6f9d3ed req-39ad69ca-2889-4451-8703-932e329c83e2 tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f59bee4c-84bf-40be-b082-4f6ad6f9d3ed req-39ad69ca-2889-4451-8703-932e329c83e2 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:22 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ccdf8e-aaa5-49be-84af-772ebb056c21]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-f59bee4c-84bf-40be-b082-4f6ad6f9d3ed req-39ad69ca-2889-4451-8703-932e329c83e2 tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:22 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4
Nov 14 03:25:22 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:22 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=31,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=2 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:25:23 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-f59bee4c-84bf-40be-b082-4f6ad6f9d3ed req-39ad69ca-2889-4451-8703-932e329c83e2 tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4" returned: 0 in 0.751s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f59bee4c-84bf-40be-b082-4f6ad6f9d3ed req-39ad69ca-2889-4451-8703-932e329c83e2 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.763s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-f59bee4c-84bf-40be-b082-4f6ad6f9d3ed req-39ad69ca-2889-4451-8703-932e329c83e2 tempest-AttachVolumeShelveTestJSON-1837662251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-bde4656b-334f-43bb-890e-b7781e83cab4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ee8d43d-1bc6-4c6e-b6be-cc544e792ca0', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:25:23 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-f59bee4c-84bf-40be-b082-4f6ad6f9d3ed req-39ad69ca-2889-4451-8703-932e329c83e2 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-f59bee4c-84bf-40be-b082-4f6ad6f9d3ed req-39ad69ca-2889-4451-8703-932e329c83e2 tempest-AttachVolumeShelveTestJSON-1837662251 None] attachment_update completed successfully.
Nov 14 03:25:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-6ddbb3ad-eb0f-422a-b921-2610cd579515 req-6d6352fb-e6cb-447d-98f6-f22c3688bbcf tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-6ddbb3ad-eb0f-422a-b921-2610cd579515 req-6d6352fb-e6cb-447d-98f6-f22c3688bbcf tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:25 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-6ddbb3ad-eb0f-422a-b921-2610cd579515 req-6d6352fb-e6cb-447d-98f6-f22c3688bbcf tempest-TestInstancesWithCinderVolumes-284758692 None] Terminate volume connection completed successfully.
Nov 14 03:25:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-6ddbb3ad-eb0f-422a-b921-2610cd579515 req-6d6352fb-e6cb-447d-98f6-f22c3688bbcf tempest-TestInstancesWithCinderVolumes-284758692 None] Deleting attachment 16d49805-19fc-4810-a7da-a4f2b5d64898. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:25:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "cinder-36d521c1-5663-4149-99bf-e98b84d235e8-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-36d521c1-5663-4149-99bf-e98b84d235e8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "cinder-quobyte-36d521c1-5663-4149-99bf-e98b84d235e8" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-quobyte-36d521c1-5663-4149-99bf-e98b84d235e8" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:27 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[216e3f8d-a206-410b-ad06-d7552a6567d3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:27 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8
Nov 14 03:25:27 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:28 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8" returned: 0 in 0.818s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:28 devstack sudo[90556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8
Nov 14 03:25:28 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:29 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-36d521c1-5663-4149-99bf-e98b84d235e8" returned: 0 in 0.901s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-quobyte-36d521c1-5663-4149-99bf-e98b84d235e8" released by "delete_volume" :: held 1.788s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:29 devstack cinder-volume[80846]: WARNING cinder.quota [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976439373-71108718 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976439373-71108718, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:25:29 devstack cinder-volume[80846]: WARNING cinder.quota [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976439373-71108718 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976439373-71108718, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Created reservations ['ae41ef56-5e15-4bcc-82f8-5540361d0224', 'bb1b3d3f-7bc9-4fbf-a078-b464c30a8195', '66ad2363-0221-466a-a120-81ba928e8216', '4c6c8a01-1ab5-42e6-9b9d-599a41a90334'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:29 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:25:29 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:29 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.606s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:25:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Deleted volume successfully.
Nov 14 03:25:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bcbacb08-6e68-4f44-9da1-13eba7607409 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-36d521c1-5663-4149-99bf-e98b84d235e8-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Flow 'volume_create_manager' (c7690041-4d2d-4ca8-a6e7-2b7d1cd910de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe90d3f3-2ebf-4854-92ea-6a817aa143c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe90d3f3-2ebf-4854-92ea-6a817aa143c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1257996831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c24cb2d-4ee6-41a2-bf3b-55300c729046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ba7cf4a38a468a850b7b3087276988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:25:30Z,use_quota=True,user_id='409817f5838f4fafa4b5f56b2cbca602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3718811a-7fe7-4c9a-bf9b-352afdf627bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3718811a-7fe7-4c9a-bf9b-352afdf627bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf587422-c40f-4d70-936e-bebe2fe64b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf587422-c40f-4d70-936e-bebe2fe64b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c24cb2d-4ee6-41a2-bf3b-55300c729046', 'volume_name': 'volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed27447190>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cc69db-66b1-43ee-940b-ca2fb67426b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cc69db-66b1-43ee-940b-ca2fb67426b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5773c2e1-cf61-4dce-900b-d894a6075c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:30 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed27447190>}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Cloning 5c24cb2d-4ee6-41a2-bf3b-55300c729046 from image 505e4538-4930-46f5-ae28-a520ed743bcf  at location (None, None). {{(pid=80846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Nov 14 03:25:30 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:25:30 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Image download 20.69 MB at 20.69 MB/s
Nov 14 03:25:31 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[84357350-d74d-4fc5-95a5-5479bad71390]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:31 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD
Nov 14 03:25:31 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:31 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD" returned: 0 in 0.905s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:31 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf is fetched for user 409817f5838f4fafa4b5f56b2cbca602. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79d46b6-ce45-467d-8342-9147e9c8878d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:32 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD
Nov 14 03:25:32 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:32 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1257996831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c24cb2d-4ee6-41a2-bf3b-55300c729046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ba7cf4a38a468a850b7b3087276988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:25:30Z,use_quota=True,user_id='409817f5838f4fafa4b5f56b2cbca602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Creating volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:25:32 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:25:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:32 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1073741824
Nov 14 03:25:32 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:33 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1073741824" returned: 0 in 0.724s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:33 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:25:33 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:33 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:25:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:33 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Attempting download of 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:25:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8dd98f-9047-4c16-91df-d9cef33fc25b]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_tzepat8g {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:34 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_tzepat8g
Nov 14 03:25:34 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:34 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_tzepat8g" returned: 0 in 0.751s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_tzepat8g {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:34 devstack sudo[90657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_tzepat8g
Nov 14 03:25:34 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:35 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_tzepat8g" returned: 1 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_tzepat8g' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:25:35 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba41ed24-6e60-4acb-bf8b-64789f367b59]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:35 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD
Nov 14 03:25:35 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-d3bbb8b9-6483-4f71-8dc7-73d6110d4616 req-a3f88a45-dbbb-43e3-8c84-9ff0d165542b tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-d3bbb8b9-6483-4f71-8dc7-73d6110d4616 req-a3f88a45-dbbb-43e3-8c84-9ff0d165542b tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:35 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-d3bbb8b9-6483-4f71-8dc7-73d6110d4616 req-a3f88a45-dbbb-43e3-8c84-9ff0d165542b tempest-TestInstancesWithCinderVolumes-284758692 None] Terminate volume connection completed successfully.
Nov 14 03:25:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-d3bbb8b9-6483-4f71-8dc7-73d6110d4616 req-a3f88a45-dbbb-43e3-8c84-9ff0d165542b tempest-TestInstancesWithCinderVolumes-284758692 None] Deleting attachment 63c9c5a6-c31c-41ee-9da0-224d0fa8e781. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:25:35 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD" returned: 0 in 0.560s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:35 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] 505e4538-4930-46f5-ae28-a520ed743bcf was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:25:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:36 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:25:36 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "cinder-5fd06498-5ed6-4718-8af6-ca7244272168-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-5fd06498-5ed6-4718-8af6-ca7244272168-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:36 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "cinder-quobyte-5fd06498-5ed6-4718-8af6-ca7244272168" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-quobyte-5fd06498-5ed6-4718-8af6-ca7244272168" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d5cd9-5931-402f-a55f-b1ec4c75bff2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:36 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 0.959s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_v4h_ntc6devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:25:36 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Converted 112.00 MB image at 112.00 MB/s
Nov 14 03:25:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:36 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1G
Nov 14 03:25:36 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:37 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168
Nov 14 03:25:37 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:37 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1G" returned: 0 in 0.558s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:37 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ba4e3-beb7-4bc7-83cc-2e3b40081211]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:37 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168" returned: 0 in 0.729s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:37 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168
Nov 14 03:25:37 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:37 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:25:37 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:38 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5fd06498-5ed6-4718-8af6-ca7244272168" returned: 0 in 0.992s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-quobyte-5fd06498-5ed6-4718-8af6-ca7244272168" released by "delete_volume" :: held 1.746s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:38 devstack cinder-volume[80846]: WARNING cinder.quota [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-324407944-887052908 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-324407944-887052908, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:25:38 devstack cinder-volume[80846]: WARNING cinder.quota [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-324407944-887052908 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-324407944-887052908, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Created reservations ['dc5d2fd2-0813-4dac-b55e-8e2252dade8e', '6ff33103-4875-4828-9ca3-c65f145dc553', 'e210a1d3-d0f4-4ed4-837a-2f603c93103e', '761941d7-ef6a-4d2c-b1bd-c689bb5aa059'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:38 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:25:38 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:38 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 1.283s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:38 devstack sudo[90789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:25:38 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:39 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 1.142s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:39 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:25:39 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Deleted volume successfully.
Nov 14 03:25:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-bdacb00e-c552-472b-b260-a44382c4caa8 tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-5fd06498-5ed6-4718-8af6-ca7244272168-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:40 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 1 in 1.334s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Downloaded image 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046 successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf for user 409817f5838f4fafa4b5f56b2cbca602 is deleted. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Marking volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046 as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Copying metadata from image 505e4538-4930-46f5-ae28-a520ed743bcf to 5c24cb2d-4ee6-41a2-bf3b-55300c729046. {{(pid=80846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Creating volume glance metadata for volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046 backed by image 505e4538-4930-46f5-ae28-a520ed743bcf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5773c2e1-cf61-4dce-900b-d894a6075c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed27447190>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ae9f5c-e5a9-49ed-9e07-94c2c71a6411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:25:40 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Volume volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 (5c24cb2d-4ee6-41a2-bf3b-55300c729046): created successfully
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ae9f5c-e5a9-49ed-9e07-94c2c71a6411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:25:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Flow 'volume_create_manager' (c7690041-4d2d-4ca8-a6e7-2b7d1cd910de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:25:40 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-cf8035e0-7a90-4f47-8ae7-cf5974a2d4fd tempest-ServerActionsV293TestJSON-192716349 None] Created volume successfully.
Nov 14 03:25:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-9c28f919-e3ff-4f11-8cfc-f7ead273fca7 req-140229f5-ddf0-45be-8b66-4f3c5513aa90 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-9c28f919-e3ff-4f11-8cfc-f7ead273fca7 req-140229f5-ddf0-45be-8b66-4f3c5513aa90 tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:43 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-9c28f919-e3ff-4f11-8cfc-f7ead273fca7 req-140229f5-ddf0-45be-8b66-4f3c5513aa90 tempest-TestInstancesWithCinderVolumes-284758692 None] Terminate volume connection completed successfully.
Nov 14 03:25:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-9c28f919-e3ff-4f11-8cfc-f7ead273fca7 req-140229f5-ddf0-45be-8b66-4f3c5513aa90 tempest-TestInstancesWithCinderVolumes-284758692 None] Deleting attachment e524756c-85d3-4074-a09c-9b6823c90c82. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[01338bfc-edcb-4b28-ab17-9cdc10159f4b]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:48 devstack sudo[90897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:25:48 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "cinder-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=63,cinder:UPDATE=56,cinder:INSERT=18,cinder:DELETE=2 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:25:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "cinder-quobyte-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-quobyte-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a71a4ec-c391-4e5e-b649-5509fc9ea5af]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:48 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:25:48 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:48 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 0.707s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:49 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:25:49 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:49 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 0 in 0.879s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:49 devstack sudo[90907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:25:49 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:49 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 1 in 0.920s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:25:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.684s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67328daf-cf35-45d2-908a-40d50b0a1871', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:25:49 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:25:49 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-17e69fe1-50f3-4844-a60d-90e74d71f4fa req-3d4463f3-396d-4cbb-b954-843b365e15d4 tempest-ServerActionsV293TestJSON-192716349 None] attachment_update completed successfully.
Nov 14 03:25:50 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 1 in 0.709s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:50 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba
Nov 14 03:25:50 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:50 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" returned: 0 in 0.506s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-quobyte-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba" released by "delete_volume" :: held 2.175s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:50 devstack cinder-volume[80846]: WARNING cinder.quota [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1784597613-438744402 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1784597613-438744402, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:25:50 devstack cinder-volume[80846]: WARNING cinder.quota [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1784597613-438744402 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1784597613-438744402, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Created reservations ['f316c499-1d46-46f3-979a-1c924edaa68e', 'c02030ec-935e-4b5e-bd9a-55035d93593b', 'ca02adee-8624-4d8f-9dee-5cc29e381c14', '0a576a2e-c918-4fbe-89b0-ef2d82dfa499'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:50 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:25:50 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:51 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.490s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:51 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:25:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Deleted volume successfully.
Nov 14 03:25:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a01a6d98-3327-4af3-999e-19d46dd7b0ef tempest-TestInstancesWithCinderVolumes-284758692 None] Lock "cinder-7dead9de-6541-4d3f-b2e9-bde8a3a2c2ba-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:25:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:25:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:25:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:25:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:25:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:25:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:25:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:25:54 devstack sudo[90927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:25:54 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:25:55 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root
Nov 14 03:25:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 1.068s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:25:55 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:26:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:26:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=31,cinder:SELECT=37,cinder:INSERT=13,cinder:DELETE=3 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:26:46 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Flow 'volume_create_manager' (00442eed-fab8-4b61-8cac-e26f52624ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d449f419-bfce-495e-acec-c9e1523f2ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d449f419-bfce-495e-acec-c9e1523f2ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2098753581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3cf9b7-790b-47c6-a89b-1e2fba1236f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0062f4234b4a139a1f5cd353756fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:26:47Z,use_quota=True,user_id='c4685012846f44e2a9ae537c2280b867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c01df0c-33b7-40ed-96d7-cdba663cca58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c01df0c-33b7-40ed-96d7-cdba663cca58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1683fc6b-b9f6-4f69-988f-1b51be076734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1683fc6b-b9f6-4f69-988f-1b51be076734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3cf9b7-790b-47c6-a89b-1e2fba1236f5', 'volume_name': 'volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a643c5ce-66c1-4d35-bede-22c3d76ccca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a643c5ce-66c1-4d35-bede-22c3d76ccca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc0792f-46f6-4051-a48d-935053ecd27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:26:46 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Volume dc3cf9b7-790b-47c6-a89b-1e2fba1236f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5', 'volume_size': 1}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2098753581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3cf9b7-790b-47c6-a89b-1e2fba1236f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0062f4234b4a139a1f5cd353756fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:26:47Z,use_quota=True,user_id='c4685012846f44e2a9ae537c2280b867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Creating volume dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:26:46 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:26:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:26:46 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 1073741824
Nov 14 03:26:46 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:26:47 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 1073741824" returned: 0 in 0.612s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:26:47 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5
Nov 14 03:26:47 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:26:47 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5" returned: 0 in 0.569s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc0792f-46f6-4051-a48d-935053ecd27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc826db-bbc0-4133-9454-0edb30c550bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:26:47 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Volume volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 (dc3cf9b7-790b-47c6-a89b-1e2fba1236f5): created successfully
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc826db-bbc0-4133-9454-0edb30c550bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:26:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Flow 'volume_create_manager' (00442eed-fab8-4b61-8cac-e26f52624ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:26:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1b6c4974-7bcc-4ba3-8732-b6cd78c8b286 tempest-AttachVolumeNegativeTest-460057857 None] Created volume successfully.
Nov 14 03:26:49 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-7ce4abc8-c0d5-4789-9787-4aed22eef99d req-53f3298f-2bfe-437f-bf5e-ca92dc85d8e4 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:26:49 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-7ce4abc8-c0d5-4789-9787-4aed22eef99d req-53f3298f-2bfe-437f-bf5e-ca92dc85d8e4 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:26:49 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-7ce4abc8-c0d5-4789-9787-4aed22eef99d req-53f3298f-2bfe-437f-bf5e-ca92dc85d8e4 tempest-AttachVolumeShelveTestJSON-1837662251 None] Terminate volume connection completed successfully.
Nov 14 03:26:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-7ce4abc8-c0d5-4789-9787-4aed22eef99d req-53f3298f-2bfe-437f-bf5e-ca92dc85d8e4 tempest-AttachVolumeShelveTestJSON-1837662251 None] Deleting attachment 2ee8d43d-1bc6-4c6e-b6be-cc544e792ca0. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:26:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f1d9033e-36ed-47c4-a59b-6bc43361c2bd req-692c7bdf-6034-43ad-93d3-b79d1207515c tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:26:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f1d9033e-36ed-47c4-a59b-6bc43361c2bd req-692c7bdf-6034-43ad-93d3-b79d1207515c tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:26:51 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2232c121-64b4-4df7-9535-5b46130a4986]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:26:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-f1d9033e-36ed-47c4-a59b-6bc43361c2bd req-692c7bdf-6034-43ad-93d3-b79d1207515c tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:26:51 devstack sudo[91253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5
Nov 14 03:26:51 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:26:52 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root
Nov 14 03:26:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-f1d9033e-36ed-47c4-a59b-6bc43361c2bd req-692c7bdf-6034-43ad-93d3-b79d1207515c tempest-AttachVolumeNegativeTest-460057857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5" returned: 0 in 0.982s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:26:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f1d9033e-36ed-47c4-a59b-6bc43361c2bd req-692c7bdf-6034-43ad-93d3-b79d1207515c tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.994s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:26:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-f1d9033e-36ed-47c4-a59b-6bc43361c2bd req-692c7bdf-6034-43ad-93d3-b79d1207515c tempest-AttachVolumeNegativeTest-460057857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e189fd8-c0f1-4c02-86bf-df001ab13dc4', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:26:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-f1d9033e-36ed-47c4-a59b-6bc43361c2bd req-692c7bdf-6034-43ad-93d3-b79d1207515c tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:26:52 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-f1d9033e-36ed-47c4-a59b-6bc43361c2bd req-692c7bdf-6034-43ad-93d3-b79d1207515c tempest-AttachVolumeNegativeTest-460057857 None] attachment_update completed successfully.
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:26:54 devstack sudo[91296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:26:54 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:26:54 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:26:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:26:59 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-aa0821a7-9c6c-4312-88a2-470cede6524e req-b8432ae8-70e8-4949-94c6-44edffd0fe32 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:26:59 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-aa0821a7-9c6c-4312-88a2-470cede6524e req-b8432ae8-70e8-4949-94c6-44edffd0fe32 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:26:59 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-aa0821a7-9c6c-4312-88a2-470cede6524e req-b8432ae8-70e8-4949-94c6-44edffd0fe32 tempest-AttachVolumeNegativeTest-460057857 None] Terminate volume connection completed successfully.
Nov 14 03:26:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-aa0821a7-9c6c-4312-88a2-470cede6524e req-b8432ae8-70e8-4949-94c6-44edffd0fe32 tempest-AttachVolumeNegativeTest-460057857 None] Deleting attachment 3e189fd8-c0f1-4c02-86bf-df001ab13dc4. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:27:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-11ab2c89-2a61-4b72-bf5b-a58fd5d60f96 tempest-ServerActionsV293TestJSON-192716349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:27:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-11ab2c89-2a61-4b72-bf5b-a58fd5d60f96 tempest-ServerActionsV293TestJSON-192716349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:27:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-11ab2c89-2a61-4b72-bf5b-a58fd5d60f96 tempest-ServerActionsV293TestJSON-192716349 None] Terminate volume connection completed successfully.
Nov 14 03:27:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-11ab2c89-2a61-4b72-bf5b-a58fd5d60f96 tempest-ServerActionsV293TestJSON-192716349 None] Deleting attachment 67328daf-cf35-45d2-908a-40d50b0a1871. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:27:07 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Attempting download of 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:27:07 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab4b662-857a-46f4-bf8c-013bc202b667]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:27:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:07 devstack sudo[91409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m
Nov 14 03:27:07 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:08 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m" returned: 0 in 0.696s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:08 devstack sudo[91413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m
Nov 14 03:27:08 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:09 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m" returned: 1 in 0.588s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:27:09 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m, size 20.69 MB, duration 1.00 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:27:09 devstack cinder-volume[80846]: INFO cinder.image.image_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Image download 20.69 MB at 20.69 MB/s
Nov 14 03:27:09 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2261a553-dbec-40ff-bc8e-d23932d9dea7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:27:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:09 devstack sudo[91417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m
Nov 14 03:27:09 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:09 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m" returned: 0 in 0.613s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:09 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] 505e4538-4930-46f5-ae28-a520ed743bcf was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:27:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:09 devstack sudo[91422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:27:09 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:11 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 1.848s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:11 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_bgidd_3m, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:27:11 devstack cinder-volume[80846]: INFO cinder.image.image_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Converted 112.00 MB image at 60.58 MB/s
Nov 14 03:27:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:11 devstack sudo[91438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1G
Nov 14 03:27:11 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:12 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 1G" returned: 0 in 0.798s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bf6fff-1634-4fb7-ab50-dea4bbef6353]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:27:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:12 devstack sudo[91499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:27:12 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:13 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 0.810s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:13 devstack sudo[91508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:27:13 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:14 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 1 in 0.699s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Downloaded image 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046 successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Marking volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046 as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Creating volume glance metadata for volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046 backed by image 505e4538-4930-46f5-ae28-a520ed743bcf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _refresh_volume_glance_meta /opt/stack/cinder/cinder/volume/manager.py:5375}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG cinder.compute.nova [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Creating Keystone auth plugin from conf {{(pid=80846) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG novaclient.v2.client [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://192.168.122.143/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "OpenStack-API-Version: compute 2.93" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c4ec1250f7130928bba905b99dcf91ff208cfe74ab3235cab9772ab0a71f2ca" -H "X-OpenStack-Nova-API-Version: 2.93" -H "X-OpenStack-Request-ID: req-a0f9cc79-0733-483f-aaaf-07733490f4ae" -H "X-Service-Token: {SHA256}bdce9066fc5c8bd2f3ae72e8e0ec8bc53216ae44e9083e42e497b55952c48449" -d '{"events": [{"name": "volume-reimaged", "server_uuid": "067fe5bd-396a-4b29-a190-2e6fbe8becd8", "tag": "5c24cb2d-4ee6-41a2-bf3b-55300c729046"}]}' {{(pid=80846) _http_log_request /opt/stack/data/venv/lib/python3.10/site-packages/keystoneauth1/session.py:572}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG novaclient.v2.client [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 14 Nov 2025 02:27:14 GMT OpenStack-API-Version: compute 2.93 Server: Apache/2.4.52 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.93 x-compute-request-id: req-92270b91-02e5-495f-9a5c-e8ef8d839554 x-openstack-request-id: req-92270b91-02e5-495f-9a5c-e8ef8d839554 {{(pid=80846) _http_log_response /opt/stack/data/venv/lib/python3.10/site-packages/keystoneauth1/session.py:613}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG novaclient.v2.client [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] RESP BODY: {"events": [{"name": "volume-reimaged", "server_uuid": "067fe5bd-396a-4b29-a190-2e6fbe8becd8", "tag": "5c24cb2d-4ee6-41a2-bf3b-55300c729046", "status": "completed", "code": 200}]} {{(pid=80846) _http_log_response /opt/stack/data/venv/lib/python3.10/site-packages/keystoneauth1/session.py:648}}
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG novaclient.v2.client [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] POST call to compute for http://192.168.122.143/compute/v2.1/os-server-external-events used request id req-92270b91-02e5-495f-9a5c-e8ef8d839554 {{(pid=80846) request /opt/stack/data/venv/lib/python3.10/site-packages/keystoneauth1/session.py:1073}}
Nov 14 03:27:14 devstack cinder-volume[80846]: INFO cinder.compute.nova [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Nova event response: {'name': 'volume-reimaged', 'server_uuid': '067fe5bd-396a-4b29-a190-2e6fbe8becd8', 'tag': '5c24cb2d-4ee6-41a2-bf3b-55300c729046', 'status': 'completed', 'code': 200}.
Nov 14 03:27:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-ff9244bb-cc8b-4abb-8b6d-ca8bc0c0f23a tempest-ServerActionsV293TestJSON-192716349 None] Re-imaged 505e4538-4930-46f5-ae28-a520ed743bcf to volume 5c24cb2d-4ee6-41a2-bf3b-55300c729046 successfully. {{(pid=80846) reimage /opt/stack/cinder/cinder/volume/manager.py:5418}}
Nov 14 03:27:15 devstack cinder-volume[80846]: DEBUG oslo_db.sqlalchemy.engines [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 14 03:27:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:27:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:27:15 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca84111-6ae6-46f0-a2f7-8f9365f0ccfe]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:27:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:15 devstack sudo[91524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:27:15 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:16 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 0.821s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:16 devstack sudo[91531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:27:16 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:17 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 1 in 1.021s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:27:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.950s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:27:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7705056-0747-49c8-b276-12c4324ef408', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:27:17 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:27:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-a0f9cc79-0733-483f-aaaf-07733490f4ae req-2ed77c5a-f542-4c0f-a30c-57d5868ff32e tempest-ServerActionsV293TestJSON-192716349 None] attachment_update completed successfully.
Nov 14 03:27:27 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:27:27 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=26,cinder:INSERT=12 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:27:39 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Flow 'volume_create_manager' (fe373115-ba90-4502-9514-87259683972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdfc196-66cd-4900-a532-b76cf1da6d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdfc196-66cd-4900-a532-b76cf1da6d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-237832785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1e7af3-da1e-489d-a43c-138b922008e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a11196a98c5646f08d8cb6cd641025d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:27:40Z,use_quota=True,user_id='22c1fc29c30f4769b544c9353628f88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b30197b-7bdc-4559-b163-7286b328d8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b30197b-7bdc-4559-b163-7286b328d8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65661f88-1bcd-4f92-8f92-2998b56c2e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65661f88-1bcd-4f92-8f92-2998b56c2e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a1e7af3-da1e-489d-a43c-138b922008e2', 'volume_name': 'volume-3a1e7af3-da1e-489d-a43c-138b922008e2', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b086b0-114e-470f-8bd1-b680ed62b9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b086b0-114e-470f-8bd1-b680ed62b9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:27:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b925c828-cd8c-4ec0-abca-774efbdd7d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:27:40 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Volume 3a1e7af3-da1e-489d-a43c-138b922008e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a1e7af3-da1e-489d-a43c-138b922008e2', 'volume_size': 1}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-237832785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1e7af3-da1e-489d-a43c-138b922008e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a11196a98c5646f08d8cb6cd641025d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:27:40Z,use_quota=True,user_id='22c1fc29c30f4769b544c9353628f88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Creating volume 3a1e7af3-da1e-489d-a43c-138b922008e2 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:27:40 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:40 devstack sudo[92138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2 1073741824
Nov 14 03:27:40 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:40 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2 1073741824" returned: 0 in 0.662s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:40 devstack sudo[92168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2
Nov 14 03:27:40 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:41 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2" returned: 0 in 0.517s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:27:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:27:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b925c828-cd8c-4ec0-abca-774efbdd7d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a1e7af3-da1e-489d-a43c-138b922008e2', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:27:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f69767-3190-4a0a-a309-e119633d76c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:27:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Volume volume-3a1e7af3-da1e-489d-a43c-138b922008e2 (3a1e7af3-da1e-489d-a43c-138b922008e2): created successfully
Nov 14 03:27:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f69767-3190-4a0a-a309-e119633d76c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:27:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Flow 'volume_create_manager' (fe373115-ba90-4502-9514-87259683972f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:27:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-239d4fca-a9aa-41e6-aa4c-dfa693bec1b5 tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Created volume successfully.
Nov 14 03:27:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-db0d866f-7244-49cc-88fd-b0d978e0e535 req-97277818-a75f-4240-b084-826015dad1fc tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:27:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-db0d866f-7244-49cc-88fd-b0d978e0e535 req-97277818-a75f-4240-b084-826015dad1fc tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:27:44 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ed78b-dca7-4892-b94a-43b1ebb66c63]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:27:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-db0d866f-7244-49cc-88fd-b0d978e0e535 req-97277818-a75f-4240-b084-826015dad1fc tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:45 devstack sudo[92183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2
Nov 14 03:27:45 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:45 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-db0d866f-7244-49cc-88fd-b0d978e0e535 req-97277818-a75f-4240-b084-826015dad1fc tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2" returned: 0 in 0.589s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-db0d866f-7244-49cc-88fd-b0d978e0e535 req-97277818-a75f-4240-b084-826015dad1fc tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.600s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:27:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-db0d866f-7244-49cc-88fd-b0d978e0e535 req-97277818-a75f-4240-b084-826015dad1fc tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-3a1e7af3-da1e-489d-a43c-138b922008e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76bd7c8f-3c79-43bd-8b63-bab607f49c88', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:27:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-db0d866f-7244-49cc-88fd-b0d978e0e535 req-97277818-a75f-4240-b084-826015dad1fc tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:27:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-db0d866f-7244-49cc-88fd-b0d978e0e535 req-97277818-a75f-4240-b084-826015dad1fc tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] attachment_update completed successfully.
Nov 14 03:27:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-9767942d-44e4-4c2a-a177-e4e8b86fe37a req-5c40eee8-e2a0-4ca1-863b-92ebae6905ad tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:27:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-9767942d-44e4-4c2a-a177-e4e8b86fe37a req-5c40eee8-e2a0-4ca1-863b-92ebae6905ad tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:27:52 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-9767942d-44e4-4c2a-a177-e4e8b86fe37a req-5c40eee8-e2a0-4ca1-863b-92ebae6905ad tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Terminate volume connection completed successfully.
Nov 14 03:27:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-9767942d-44e4-4c2a-a177-e4e8b86fe37a req-5c40eee8-e2a0-4ca1-863b-92ebae6905ad tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Deleting attachment 76bd7c8f-3c79-43bd-8b63-bab607f49c88. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:27:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Acquiring lock "cinder-3a1e7af3-da1e-489d-a43c-138b922008e2-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:27:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "cinder-3a1e7af3-da1e-489d-a43c-138b922008e2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:27:54 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Acquiring lock "cinder-quobyte-3a1e7af3-da1e-489d-a43c-138b922008e2" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "cinder-quobyte-3a1e7af3-da1e-489d-a43c-138b922008e2" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[932ae6f7-0be3-45ef-b0b6-5849d9ca3caf]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:54 devstack sudo[92225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:27:54 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:54 devstack sudo[92224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2
Nov 14 03:27:54 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:54 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2" returned: 0 in 0.772s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:54 devstack sudo[92233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2
Nov 14 03:27:54 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:54 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.797s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:27:55 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a1e7af3-da1e-489d-a43c-138b922008e2" returned: 0 in 0.544s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "cinder-quobyte-3a1e7af3-da1e-489d-a43c-138b922008e2" released by "delete_volume" :: held 1.366s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Created reservations ['a39e5c76-17a5-418a-859c-4d5f96313b9c', '8932af94-5383-4473-b626-891066730c9a', '5d4eb924-43d9-45d3-8398-326b616bfc55', '2e3ceb3b-1e04-494c-84fb-b2a2d6fb827e'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:27:55 devstack sudo[92238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:27:55 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:27:55 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.465s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:27:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Deleted volume successfully.
Nov 14 03:27:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9519035-78ec-4b8a-bb43-6e8621af74bf tempest-TestServerVolumeAttachScenarioOldVersion-64017829 None] Lock "cinder-3a1e7af3-da1e-489d-a43c-138b922008e2-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=14,cinder:SELECT=14,cinder:DELETE=1,cinder:INSERT=4 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:28:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=12,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:28:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (1c91d470-6690-47e9-9fa3-005496c7ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5f4e1c-7ea7-4f7e-83a1-9ede10ba4b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5f4e1c-7ea7-4f7e-83a1-9ede10ba4b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-803782011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf6f302-e343-4546-9b25-ebdc7be65b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:12Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116f0cfe-13c4-4613-a038-2865a8ffe60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116f0cfe-13c4-4613-a038-2865a8ffe60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdbac1c-22d0-4cf6-9b05-1ff09b3de6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdbac1c-22d0-4cf6-9b05-1ff09b3de6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf6f302-e343-4546-9b25-ebdc7be65b2e', 'volume_name': 'volume-adf6f302-e343-4546-9b25-ebdc7be65b2e', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a9f575-9771-4104-9631-c570fcba0fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a9f575-9771-4104-9631-c570fcba0fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6ef0fb-71ce-4728-9f14-670a9ceaacfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume adf6f302-e343-4546-9b25-ebdc7be65b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf6f302-e343-4546-9b25-ebdc7be65b2e', 'volume_size': 1}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-803782011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf6f302-e343-4546-9b25-ebdc7be65b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:12Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Creating volume adf6f302-e343-4546-9b25-ebdc7be65b2e {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:28:12 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:12 devstack sudo[92342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e 1073741824
Nov 14 03:28:12 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:12 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e 1073741824" returned: 0 in 0.599s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:12 devstack sudo[92360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e
Nov 14 03:28:12 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:13 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e" returned: 0 in 0.476s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:28:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6ef0fb-71ce-4728-9f14-670a9ceaacfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf6f302-e343-4546-9b25-ebdc7be65b2e', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba8d7f1-2e0b-46c3-9b4e-6a0fce7c84f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume volume-adf6f302-e343-4546-9b25-ebdc7be65b2e (adf6f302-e343-4546-9b25-ebdc7be65b2e): created successfully
Nov 14 03:28:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba8d7f1-2e0b-46c3-9b4e-6a0fce7c84f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (1c91d470-6690-47e9-9fa3-005496c7ae96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-80b6d205-d4bf-4a1d-a9b4-9379d09e859f tempest-CreateVolumesFromSnapshotTest-121242780 None] Created volume successfully.
Nov 14 03:28:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Creating offline snapshot 89d35cd3-71b1-41ad-82af-5bda925a18ba of volume adf6f302-e343-4546-9b25-ebdc7be65b2e {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:28:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[80709ab3-00b9-46b7-89ac-40d7f3c43673]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:14 devstack sudo[92363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e
Nov 14 03:28:14 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:15 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e" returned: 0 in 0.584s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:15 devstack sudo[92368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba 1G
Nov 14 03:28:15 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:15 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba 1G" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6f302-e343-4546-9b25-ebdc7be65b2e -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:15 devstack sudo[92374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6f302-e343-4546-9b25-ebdc7be65b2e -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba
Nov 14 03:28:15 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:16 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6f302-e343-4546-9b25-ebdc7be65b2e -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba" returned: 0 in 0.476s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:16 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba is being set with open permissions: ugo+rw
Nov 14 03:28:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:16 devstack sudo[92379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba
Nov 14 03:28:16 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:16 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba" returned: 0 in 0.425s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:16 devstack sudo[92382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.info
Nov 14 03:28:16 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:17 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.info" returned: 0 in 0.441s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:17 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.info is being set with open permissions: ugo+rw
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:17 devstack sudo[92385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.info
Nov 14 03:28:17 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:17 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.info" returned: 0 in 0.447s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.954s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8adc0385-6b79-4aac-81f9-09b898af6349 tempest-CreateVolumesFromSnapshotTest-121242780 None] Create snapshot completed successfully
Nov 14 03:28:17 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (daaee686-6329-4471-bf0c-f138e345d3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d277f6c8-9640-40dd-bd15-1d8351896c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d277f6c8-9640-40dd-bd15-1d8351896c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241803075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:18Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c183a479-ea83-4f27-a6f6-a73fe2dbb774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c183a479-ea83-4f27-a6f6-a73fe2dbb774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2e2b3c-5a2c-4db4-b508-d421f6821ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2e2b3c-5a2c-4db4-b508-d421f6821ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27', 'volume_name': 'volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97199f0-0a45-4730-b0a5-e9278a286a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97199f0-0a45-4730-b0a5-e9278a286a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fc4b5f-4ad2-4999-8f11-7abaf7b7ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:17 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume 6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27', 'volume_size': 1}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241803075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:18Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Creating volume 6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:28:17 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:28:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:17 devstack sudo[92388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27 1073741824
Nov 14 03:28:17 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (ede5f843-9993-4138-91e7-cebd70fdac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78f73a0-434b-4df6-ac3a-a134f1b4bdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78f73a0-434b-4df6-ac3a-a134f1b4bdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532483911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:18Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf03a0e-a064-4866-befe-afa75a44592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf03a0e-a064-4866-befe-afa75a44592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26146469-e59a-476f-806e-98a91653ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26146469-e59a-476f-806e-98a91653ac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17', 'volume_name': 'volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef59d92-93df-428f-8162-207d0709d2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef59d92-93df-428f-8162-207d0709d2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53885af-bc27-4b36-b8cb-8c32b9f9bbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume 21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17', 'volume_size': 1}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (601b383a-bfe0-4f43-8e2e-2c1cd8a53df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bd5f79-6ee4-49ab-8b46-91c76e93e7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bd5f79-6ee4-49ab-8b46-91c76e93e7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-65687582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28501de0-0f28-45d0-aefd-d3c3c094c2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:18Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6637e3c6-75db-4594-a386-8a03ff35944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6637e3c6-75db-4594-a386-8a03ff35944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a7ca4f-6448-401f-8046-48d552fde2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a7ca4f-6448-401f-8046-48d552fde2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28501de0-0f28-45d0-aefd-d3c3c094c2af', 'volume_name': 'volume-28501de0-0f28-45d0-aefd-d3c3c094c2af', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe6b193-f124-4146-ae89-69371f0ffb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe6b193-f124-4146-ae89-69371f0ffb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3eec85-725b-400c-9945-90bd32ee8720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume 28501de0-0f28-45d0-aefd-d3c3c094c2af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28501de0-0f28-45d0-aefd-d3c3c094c2af', 'volume_size': 1}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Flow 'volume_create_manager' (1117ded6-35a6-425a-aa9c-d2f3b1f34cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9253edf7-507b-45b0-abcb-e04aa5338d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9253edf7-507b-45b0-abcb-e04aa5338d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1032047124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07384efe-33b8-4e3f-83c9-de0c5f5251cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3667fbc45b4fb4b91992f93bd38f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:19Z,use_quota=True,user_id='1e1e1da237f44233adf44a92c6554b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33efcd4-4cad-4d29-af48-320ca74fa55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33efcd4-4cad-4d29-af48-320ca74fa55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e28608-77de-4fc6-b6c9-40bb9439b0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e28608-77de-4fc6-b6c9-40bb9439b0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07384efe-33b8-4e3f-83c9-de0c5f5251cb', 'volume_name': 'volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff616b3a-c49e-41b7-ae9b-59ae62007357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff616b3a-c49e-41b7-ae9b-59ae62007357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9638c0f5-e5d5-49d2-b84c-5190f6f71ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:18 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume 07384efe-33b8-4e3f-83c9-de0c5f5251cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb', 'volume_size': 1}
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:18 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (7e0d31fe-a41a-44e7-9d2a-46415a4091af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0334810b-f2fb-4802-998e-12b9c50d110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0334810b-f2fb-4802-998e-12b9c50d110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410069837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185d31bd-e296-49b1-8314-998cda783283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:19Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b28cb79-2e49-4cfb-b23b-c5c3083f5f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b28cb79-2e49-4cfb-b23b-c5c3083f5f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6454dd-03e5-4267-b5db-905b4698ff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6454dd-03e5-4267-b5db-905b4698ff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185d31bd-e296-49b1-8314-998cda783283', 'volume_name': 'volume-185d31bd-e296-49b1-8314-998cda783283', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a03123-f638-4a02-aca7-80900caef480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a03123-f638-4a02-aca7-80900caef480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d2d7e1-ba3b-46f0-8640-0dd1c9def284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume 185d31bd-e296-49b1-8314-998cda783283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185d31bd-e296-49b1-8314-998cda783283', 'volume_size': 1}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:19 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (9d47f558-6759-4339-9bff-77bf90f53d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1d1434-968b-4d9e-84a5-4c3dbabb0ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1d1434-968b-4d9e-84a5-4c3dbabb0ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1392848596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee60cdf5-aec7-4d24-af7b-1bfde733a138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:19Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8478343-e36d-42d9-bd11-1b43d4d9457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8478343-e36d-42d9-bd11-1b43d4d9457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae5d255-1777-458e-8a2b-48d3815650da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae5d255-1777-458e-8a2b-48d3815650da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee60cdf5-aec7-4d24-af7b-1bfde733a138', 'volume_name': 'volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ace2c4-51dc-4394-bd75-a056db0c8cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ace2c4-51dc-4394-bd75-a056db0c8cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e420b1-05b0-46bf-bdbb-d13b3eba042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume ee60cdf5-aec7-4d24-af7b-1bfde733a138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138', 'volume_size': 1}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27 1073741824" returned: 0 in 1.245s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:19 devstack sudo[92395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27
Nov 14 03:28:19 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:19 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27" returned: 0 in 0.440s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532483911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:18Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Creating volume 21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:28:19 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fc4b5f-4ad2-4999-8f11-7abaf7b7ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack sudo[92398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17 1073741824
Nov 14 03:28:19 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8a0a87-617f-43bb-9d18-62e53347366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27 (6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27): created successfully
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8a0a87-617f-43bb-9d18-62e53347366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (daaee686-6329-4471-bf0c-f138e345d3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8adb8792-12d1-4074-9bfd-a34bb93d926b tempest-CreateVolumesFromSnapshotTest-121242780 None] Created volume successfully.
Nov 14 03:28:20 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17 1073741824" returned: 0 in 0.582s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:20 devstack sudo[92403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17
Nov 14 03:28:20 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:20 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17" returned: 0 in 0.428s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.123s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-65687582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28501de0-0f28-45d0-aefd-d3c3c094c2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:18Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Creating volume 28501de0-0f28-45d0-aefd-d3c3c094c2af {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:28:20 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53885af-bc27-4b36-b8cb-8c32b9f9bbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:20 devstack sudo[92441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af 1073741824
Nov 14 03:28:20 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70de9a39-d346-4767-b045-1925d9b2aa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:20 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17 (21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17): created successfully
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70de9a39-d346-4767-b045-1925d9b2aa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (ede5f843-9993-4138-91e7-cebd70fdac51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:20 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-15e89256-e156-47ce-ade5-567b9ea3622c tempest-CreateVolumesFromSnapshotTest-121242780 None] Created volume successfully.
Nov 14 03:28:21 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af 1073741824" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:21 devstack sudo[92446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af
Nov 14 03:28:21 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:21 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af" returned: 0 in 0.422s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.713s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1032047124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07384efe-33b8-4e3f-83c9-de0c5f5251cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3667fbc45b4fb4b91992f93bd38f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:19Z,use_quota=True,user_id='1e1e1da237f44233adf44a92c6554b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Creating volume 07384efe-33b8-4e3f-83c9-de0c5f5251cb {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:28:21 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3eec85-725b-400c-9945-90bd32ee8720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28501de0-0f28-45d0-aefd-d3c3c094c2af', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:21 devstack sudo[92449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb 1073741824
Nov 14 03:28:21 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abfdb70-da40-4ef1-bf4e-c0f0b4708ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:21 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume volume-28501de0-0f28-45d0-aefd-d3c3c094c2af (28501de0-0f28-45d0-aefd-d3c3c094c2af): created successfully
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abfdb70-da40-4ef1-bf4e-c0f0b4708ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (601b383a-bfe0-4f43-8e2e-2c1cd8a53df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:21 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c006492b-fdb0-4cad-80be-571deb66834f tempest-CreateVolumesFromSnapshotTest-121242780 None] Created volume successfully.
Nov 14 03:28:22 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb 1073741824" returned: 0 in 0.577s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:22 devstack sudo[92454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb
Nov 14 03:28:22 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:22 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb" returned: 0 in 0.438s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.573s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410069837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185d31bd-e296-49b1-8314-998cda783283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:19Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Creating volume 185d31bd-e296-49b1-8314-998cda783283 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:28:22 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9638c0f5-e5d5-49d2-b84c-5190f6f71ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:22 devstack sudo[92457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283 1073741824
Nov 14 03:28:22 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62105107-1659-4e1b-a2a5-3bf8fd32f8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:22 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb (07384efe-33b8-4e3f-83c9-de0c5f5251cb): created successfully
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62105107-1659-4e1b-a2a5-3bf8fd32f8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Flow 'volume_create_manager' (1117ded6-35a6-425a-aa9c-d2f3b1f34cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:22 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-55ea6234-2802-4291-9799-e0f7cd7ffae7 tempest-AttachVolumeShelveTestJSON-1837662251 None] Created volume successfully.
Nov 14 03:28:23 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283 1073741824" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:23 devstack sudo[92467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283
Nov 14 03:28:23 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:23 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283" returned: 0 in 0.508s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.534s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1392848596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee60cdf5-aec7-4d24-af7b-1bfde733a138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509e37039ea14b1099c5d047905b29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:19Z,use_quota=True,user_id='2bd19bc4dcf24088b023288c7498c41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Creating volume ee60cdf5-aec7-4d24-af7b-1bfde733a138 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:28:23 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d2d7e1-ba3b-46f0-8640-0dd1c9def284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185d31bd-e296-49b1-8314-998cda783283', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b634ca18-c167-4528-9733-d566fa8ff4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:23 devstack sudo[92473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138 1073741824
Nov 14 03:28:23 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:23 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume volume-185d31bd-e296-49b1-8314-998cda783283 (185d31bd-e296-49b1-8314-998cda783283): created successfully
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b634ca18-c167-4528-9733-d566fa8ff4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (7e0d31fe-a41a-44e7-9d2a-46415a4091af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-fdc7fedd-18f2-422e-9bf1-6590ab5ff2ff tempest-CreateVolumesFromSnapshotTest-121242780 None] Created volume successfully.
Nov 14 03:28:24 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138 1073741824" returned: 0 in 0.621s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:24 devstack sudo[92478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138
Nov 14 03:28:24 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:24 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138" returned: 0 in 0.501s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e420b1-05b0-46bf-bdbb-d13b3eba042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acb3eb6-f71f-4e1f-bb12-3deda4a382e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:24 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138 (ee60cdf5-aec7-4d24-af7b-1bfde733a138): created successfully
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acb3eb6-f71f-4e1f-bb12-3deda4a382e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Flow 'volume_create_manager' (9d47f558-6759-4339-9bff-77bf90f53d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:24 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c91c7ea0-5f7f-44ca-8718-37abed14bfea tempest-CreateVolumesFromSnapshotTest-121242780 None] Created volume successfully.
Nov 14 03:28:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-ee60cdf5-aec7-4d24-af7b-1bfde733a138-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-ee60cdf5-aec7-4d24-af7b-1bfde733a138-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-quobyte-ee60cdf5-aec7-4d24-af7b-1bfde733a138" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-ee60cdf5-aec7-4d24-af7b-1bfde733a138" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[780cceda-2904-4c83-92d5-0f485886b35f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:25 devstack sudo[92487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138
Nov 14 03:28:25 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:26 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138" returned: 0 in 0.632s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:26 devstack sudo[92526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138
Nov 14 03:28:26 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:26 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ee60cdf5-aec7-4d24-af7b-1bfde733a138" returned: 0 in 0.460s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-ee60cdf5-aec7-4d24-af7b-1bfde733a138" released by "delete_volume" :: held 1.118s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Created reservations ['40592656-e649-4195-8b6d-f721f2cc01bf', '87ab8905-7d67-4025-ac3f-d06b7586c986', 'a266dc60-e322-4f4a-95d1-6c04f975070f', 'eeed3027-46b4-4321-9c57-cda2dd5b9e4a'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:26 devstack sudo[92529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:26 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:27 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.434s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Deleted volume successfully.
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-520682a7-ef48-4ee1-9255-044e603cd28d tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-ee60cdf5-aec7-4d24-af7b-1bfde733a138-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-185d31bd-e296-49b1-8314-998cda783283-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-185d31bd-e296-49b1-8314-998cda783283-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-quobyte-185d31bd-e296-49b1-8314-998cda783283" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-185d31bd-e296-49b1-8314-998cda783283" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb76430c-357e-43d2-9eb3-15d1af710dd7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:27 devstack sudo[92532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283
Nov 14 03:28:27 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:28 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283" returned: 0 in 0.553s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:28 devstack sudo[92545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283
Nov 14 03:28:28 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:28 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-185d31bd-e296-49b1-8314-998cda783283" returned: 0 in 0.468s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-185d31bd-e296-49b1-8314-998cda783283" released by "delete_volume" :: held 1.041s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Created reservations ['2f6cd10a-403e-4942-a210-e2cd37df518f', 'e7eb5007-e517-4219-9e69-fd8b301f16e6', 'ab1990ce-c927-4d9f-b2c4-f0b7b743b923', 'd14c2719-4cd7-4778-b465-f672b6858594'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:28 devstack sudo[92550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:28 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:29 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Flow 'volume_create_manager' (c290028d-fcbc-43b8-874e-4501974d1ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fbe854-f850-429b-9a3a-64f03d652195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fbe854-f850-429b-9a3a-64f03d652195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-307058070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99afa82-2bf2-44ad-baf8-b60fa5b99705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0062f4234b4a139a1f5cd353756fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:29Z,use_quota=True,user_id='c4685012846f44e2a9ae537c2280b867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8a5920-6df5-4445-a2e2-37efdd5a74d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8a5920-6df5-4445-a2e2-37efdd5a74d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab53733b-fe47-492e-be67-07dcb3585995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab53733b-fe47-492e-be67-07dcb3585995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99afa82-2bf2-44ad-baf8-b60fa5b99705', 'volume_name': 'volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3da56bd-ef43-4516-8069-005acc4839b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3da56bd-ef43-4516-8069-005acc4839b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1f5f2d-4c3d-4c3e-8dc7-f86b76d694ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:29 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Volume c99afa82-2bf2-44ad-baf8-b60fa5b99705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705', 'volume_size': 1}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-307058070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99afa82-2bf2-44ad-baf8-b60fa5b99705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0062f4234b4a139a1f5cd353756fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:28:29Z,use_quota=True,user_id='c4685012846f44e2a9ae537c2280b867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Creating volume c99afa82-2bf2-44ad-baf8-b60fa5b99705 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:28:29 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:29 devstack sudo[92554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705 1073741824
Nov 14 03:28:29 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:29 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.562s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Deleted volume successfully.
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c874a309-4920-44ed-8ecf-737988828d89 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-185d31bd-e296-49b1-8314-998cda783283-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:29 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705 1073741824" returned: 0 in 0.683s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:29 devstack sudo[92562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705
Nov 14 03:28:29 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-28501de0-0f28-45d0-aefd-d3c3c094c2af-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-28501de0-0f28-45d0-aefd-d3c3c094c2af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-quobyte-28501de0-0f28-45d0-aefd-d3c3c094c2af" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-28501de0-0f28-45d0-aefd-d3c3c094c2af" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a704b-915d-4adf-ba3b-fdfa325a2481]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:30 devstack sudo[92564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af
Nov 14 03:28:30 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:30 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705" returned: 0 in 0.534s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1f5f2d-4c3d-4c3e-8dc7-f86b76d694ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacf8e42-1c9f-4f51-96ce-24c838be102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:28:30 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Volume volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705 (c99afa82-2bf2-44ad-baf8-b60fa5b99705): created successfully
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacf8e42-1c9f-4f51-96ce-24c838be102c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Flow 'volume_create_manager' (c290028d-fcbc-43b8-874e-4501974d1ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:28:30 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f438498e-dabc-4f76-bb90-96f1b06f28fb tempest-AttachVolumeNegativeTest-460057857 None] Created volume successfully.
Nov 14 03:28:30 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af" returned: 0 in 0.677s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:30 devstack sudo[92579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af
Nov 14 03:28:30 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:31 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28501de0-0f28-45d0-aefd-d3c3c094c2af" returned: 0 in 0.598s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-28501de0-0f28-45d0-aefd-d3c3c094c2af" released by "delete_volume" :: held 1.302s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Created reservations ['88bb6cb6-7097-4fcc-ae30-df982c9d264a', 'de6f9139-8874-4a02-86bd-ceb7cc9e696a', 'adbbe2d7-379e-4e79-81d1-04d2f8cb232f', '920a62dc-5489-43ae-9f7e-268384eefc9e'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:31 devstack sudo[92617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:31 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:31 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.488s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:31 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Deleted volume successfully.
Nov 14 03:28:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea8e66d0-1c2d-4198-bfc0-f6cd9ce1e4f3 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-28501de0-0f28-45d0-aefd-d3c3c094c2af-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:32 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-quobyte-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:32 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ca998-a92d-42e6-b68b-e44e2984cddc]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:32 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17
Nov 14 03:28:32 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:32 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17" returned: 0 in 0.670s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:32 devstack sudo[92632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17
Nov 14 03:28:32 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:33 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17" returned: 0 in 0.451s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17" released by "delete_volume" :: held 1.146s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Created reservations ['10fda39d-9979-4834-9696-ec9ca8212ed4', '9ec363db-edbe-4e43-a2d0-d253456c19fb', 'e53abc52-cafc-4efd-9689-63a110ffc7d2', 'facb946c-cc4d-4cdb-b9ad-7f9b18c84fef'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:33 devstack sudo[92635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:33 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-9ec9ff92-b4b2-43c2-ae22-fd27a87c28ca tempest-ServerActionsV293TestJSON-192716349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-9ec9ff92-b4b2-43c2-ae22-fd27a87c28ca tempest-ServerActionsV293TestJSON-192716349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-9ec9ff92-b4b2-43c2-ae22-fd27a87c28ca tempest-ServerActionsV293TestJSON-192716349 None] Terminate volume connection completed successfully.
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-9ec9ff92-b4b2-43c2-ae22-fd27a87c28ca tempest-ServerActionsV293TestJSON-192716349 None] Deleting attachment b7705056-0747-49c8-b276-12c4324ef408. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:28:33 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Deleted volume successfully.
Nov 14 03:28:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a575026d-a8ee-4592-a82a-79bee9664b18 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-21a05e4b-b6aa-4d71-a8ff-4c57c10e0f17-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ed08a44b-a11a-40b3-930f-85bcb14056b5 req-ac5ef513-8aad-4177-8045-4596da58e3ca tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ed08a44b-a11a-40b3-930f-85bcb14056b5 req-ac5ef513-8aad-4177-8045-4596da58e3ca tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cde04f-2819-4de0-964e-d915cfb358eb]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-ed08a44b-a11a-40b3-930f-85bcb14056b5 req-ac5ef513-8aad-4177-8045-4596da58e3ca tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:34 devstack sudo[92647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705
Nov 14 03:28:34 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Acquiring lock "cinder-5c24cb2d-4ee6-41a2-bf3b-55300c729046-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Lock "cinder-5c24cb2d-4ee6-41a2-bf3b-55300c729046-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Acquiring lock "cinder-quobyte-5c24cb2d-4ee6-41a2-bf3b-55300c729046" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Lock "cinder-quobyte-5c24cb2d-4ee6-41a2-bf3b-55300c729046" acquired by "delete_volume" :: waited 0.030s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6875af-9468-4f18-8229-184e4e303e7c]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-quobyte-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b11b84-2e10-45ef-b448-81e670715a8d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:34 devstack sudo[92650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:28:34 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:34 devstack sudo[92651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27
Nov 14 03:28:34 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:34 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-ed08a44b-a11a-40b3-930f-85bcb14056b5 req-ac5ef513-8aad-4177-8045-4596da58e3ca tempest-AttachVolumeNegativeTest-460057857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705" returned: 0 in 0.590s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ed08a44b-a11a-40b3-930f-85bcb14056b5 req-ac5ef513-8aad-4177-8045-4596da58e3ca tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.599s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-ed08a44b-a11a-40b3-930f-85bcb14056b5 req-ac5ef513-8aad-4177-8045-4596da58e3ca tempest-AttachVolumeNegativeTest-460057857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7a7cd9d-2d00-4a0b-bc36-db87bad1c3da', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:28:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-ed08a44b-a11a-40b3-930f-85bcb14056b5 req-ac5ef513-8aad-4177-8045-4596da58e3ca tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:34 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-ed08a44b-a11a-40b3-930f-85bcb14056b5 req-ac5ef513-8aad-4177-8045-4596da58e3ca tempest-AttachVolumeNegativeTest-460057857 None] attachment_update completed successfully.
Nov 14 03:28:35 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 0.586s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:35 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27" returned: 0 in 0.642s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:35 devstack sudo[92667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27
Nov 14 03:28:35 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:35 devstack sudo[92659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:28:35 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:35 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 1 in 0.632s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:35 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27" returned: 0 in 0.531s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:35 devstack sudo[92737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046
Nov 14 03:28:35 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27" released by "delete_volume" :: held 1.198s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Created reservations ['b0390291-10f7-4efd-bfd6-2ae2be4ff55f', '4bfcaefc-e67d-429d-ad97-7d659ccf3c48', '4af29f96-5efa-4cb0-9563-f4521e219668', '51dcf976-81d9-418b-baa0-2de0c84fae54'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:35 devstack sudo[93053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:35 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-077de402-b79d-4670-aa91-e2bbae451f88 req-21af69da-2562-4106-a25c-c6373d5c2715 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-077de402-b79d-4670-aa91-e2bbae451f88 req-21af69da-2562-4106-a25c-c6373d5c2715 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-077de402-b79d-4670-aa91-e2bbae451f88 req-21af69da-2562-4106-a25c-c6373d5c2715 tempest-AttachVolumeShelveTestJSON-1837662251 None] No connector for attachment fecae71d-8748-4ac8-ad98-6b02d2e2b53f; skipping storage backend terminate_connection call. {{(pid=80846) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Nov 14 03:28:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-077de402-b79d-4670-aa91-e2bbae451f88 req-21af69da-2562-4106-a25c-c6373d5c2715 tempest-AttachVolumeShelveTestJSON-1837662251 None] Deleting attachment fecae71d-8748-4ac8-ad98-6b02d2e2b53f. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:28:36 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-5c24cb2d-4ee6-41a2-bf3b-55300c729046" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Lock "cinder-quobyte-5c24cb2d-4ee6-41a2-bf3b-55300c729046" released by "delete_volume" :: held 1.837s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.quota [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Created reservations ['9307ca09-8b7a-4282-b358-404754eef1da', '51c29c65-a5ca-4fb0-9c87-4f677c21e833', '50e6119e-df00-4f04-b4c2-3e7c0379c469', '01d3cbeb-aa33-413b-a61b-92d098ca8642'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:36 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.536s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:36 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Deleted volume successfully.
Nov 14 03:28:36 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:36 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7f2ae52a-c5a0-4486-8c79-79b2544b4fcd tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-6fd6a8fb-d6d7-43b2-aa5f-36edf54bac27-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-89d35cd3-71b1-41ad-82af-5bda925a18ba-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-89d35cd3-71b1-41ad-82af-5bda925a18ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:36 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-quobyte-adf6f302-e343-4546-9b25-ebdc7be65b2e" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-adf6f302-e343-4546-9b25-ebdc7be65b2e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-quobyte-89d35cd3-71b1-41ad-82af-5bda925a18ba" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-89d35cd3-71b1-41ad-82af-5bda925a18ba" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Deleting offline snapshot 89d35cd3-71b1-41ad-82af-5bda925a18ba of volume adf6f302-e343-4546-9b25-ebdc7be65b2e {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] snapshot_file for this snap is: volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cbc580-2b4a-41e1-a03c-7d62d3f33625]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:36 devstack sudo[93061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba
Nov 14 03:28:36 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:37 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.726s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG cinder.manager [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:37 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Deleted volume successfully.
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-a83adf55-0b70-4fdb-b6ce-0a0319b78fd1 req-ea3acdb1-48a6-4ea1-82bc-0dbc58983dd1 tempest-ServerActionsV293TestJSON-192716349 None] Lock "cinder-5c24cb2d-4ee6-41a2-bf3b-55300c729046-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:37 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba" returned: 0 in 0.710s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adf6f302-e343-4546-9b25-ebdc7be65b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc56645-efc8-4f1d-9ede-cf037e410f28]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:37 devstack sudo[93069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e
Nov 14 03:28:37 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:37 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e" returned: 0 in 0.571s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:37 devstack sudo[93074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba
Nov 14 03:28:37 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:38 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba" returned: 0 in 0.565s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:38 devstack sudo[93079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba
Nov 14 03:28:38 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:39 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e.89d35cd3-71b1-41ad-82af-5bda925a18ba" returned: 0 in 0.550s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-89d35cd3-71b1-41ad-82af-5bda925a18ba" released by "_delete_snapshot" :: held 2.473s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-adf6f302-e343-4546-9b25-ebdc7be65b2e" released by "delete_snapshot" :: held 2.492s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Created reservations ['b80022f2-7b21-41f8-ae15-bd6d829c0b96', 'bcd17ed7-a03e-4eea-9fa8-5f82a8174c39', 'baeb3bfc-e025-45dd-9a7a-e5ff4ac235bf', '1c719cd4-9de9-40d9-931a-0e7ad8d1e35e'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:39 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Delete snapshot completed successfully.
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1672bcff-3c22-4117-930c-a8b5883d3a27 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-89d35cd3-71b1-41ad-82af-5bda925a18ba-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-adf6f302-e343-4546-9b25-ebdc7be65b2e-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-adf6f302-e343-4546-9b25-ebdc7be65b2e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:39 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "cinder-quobyte-adf6f302-e343-4546-9b25-ebdc7be65b2e" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-adf6f302-e343-4546-9b25-ebdc7be65b2e" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[11abe3f3-b0ec-48c7-a1d0-14144bdea9e2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:39 devstack sudo[93083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e
Nov 14 03:28:39 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:40 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e" returned: 0 in 0.596s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:40 devstack sudo[93088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e
Nov 14 03:28:40 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:41 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-adf6f302-e343-4546-9b25-ebdc7be65b2e" returned: 0 in 0.577s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-quobyte-adf6f302-e343-4546-9b25-ebdc7be65b2e" released by "delete_volume" :: held 1.236s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Created reservations ['9bdca4c0-c2d3-4abf-9fbb-2a7aa72f1125', 'f9b9c7f8-736d-4897-85d1-635c8c2da4a7', '36a4b201-398b-4870-a1f1-b746fd21288c', 'f77ef77b-fa68-4f1b-942f-1652836eaf9e'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:41 devstack sudo[93119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:41 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-cd52895e-7bc0-410c-9e7b-148b34b640f8 req-ff863602-b57f-43d1-b89b-e4c5a7819669 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-cd52895e-7bc0-410c-9e7b-148b34b640f8 req-ff863602-b57f-43d1-b89b-e4c5a7819669 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-cd52895e-7bc0-410c-9e7b-148b34b640f8 req-ff863602-b57f-43d1-b89b-e4c5a7819669 tempest-AttachVolumeNegativeTest-460057857 None] Terminate volume connection completed successfully.
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-cd52895e-7bc0-410c-9e7b-148b34b640f8 req-ff863602-b57f-43d1-b89b-e4c5a7819669 tempest-AttachVolumeNegativeTest-460057857 None] Deleting attachment e7a7cd9d-2d00-4a0b-bc36-db87bad1c3da. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:28:41 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.530s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Deleted volume successfully.
Nov 14 03:28:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8f87c98c-f4cc-4bf3-b067-425565c6edc7 tempest-CreateVolumesFromSnapshotTest-121242780 None] Lock "cinder-adf6f302-e343-4546-9b25-ebdc7be65b2e-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "cinder-c99afa82-2bf2-44ad-baf8-b60fa5b99705-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-c99afa82-2bf2-44ad-baf8-b60fa5b99705-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:51 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "cinder-quobyte-c99afa82-2bf2-44ad-baf8-b60fa5b99705" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-quobyte-c99afa82-2bf2-44ad-baf8-b60fa5b99705" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:51 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886bc5e-cf5c-4ea6-9978-48bd6c550732]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:51 devstack sudo[93196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705
Nov 14 03:28:51 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:51 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705" returned: 0 in 0.665s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:51 devstack sudo[93203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705
Nov 14 03:28:51 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:52 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c99afa82-2bf2-44ad-baf8-b60fa5b99705" returned: 0 in 0.978s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-quobyte-c99afa82-2bf2-44ad-baf8-b60fa5b99705" released by "delete_volume" :: held 1.675s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Created reservations ['e5f45151-40c6-4fdb-9c64-c6b8cbb6aa42', 'ec1f4821-f1d6-45d8-af74-2fc06542c9bd', '8a6c7ec8-7539-4440-ad4e-8e49ad5a5ed6', '94658c24-4c1e-4dc7-84a5-1daa939111b0'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:52 devstack sudo[93267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:52 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "cinder-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:53 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "cinder-quobyte-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-quobyte-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd1d9a1-e857-457d-86ec-fa4e0af91672]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:53 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.700s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Deleted volume successfully.
Nov 14 03:28:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-38767d48-b355-4f0a-a9e2-d68efc42cca5 tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-c99afa82-2bf2-44ad-baf8-b60fa5b99705-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:53 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5
Nov 14 03:28:53 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:54 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5" returned: 0 in 0.593s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:54 devstack sudo[93276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:54 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:54 devstack sudo[93278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5
Nov 14 03:28:54 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:54 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.463s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:54 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5" returned: 0 in 0.497s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-quobyte-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5" released by "delete_volume" :: held 1.146s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Created reservations ['3748f6a0-5d56-48cb-b574-afc5bead87cd', '7e051009-629a-48e2-aa89-bb77aa69d220', 'f5496185-438b-479c-b5d7-677e2dd1bff0', 'ea498586-cbaa-402f-84fb-bb09eae04822'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:54 devstack sudo[93282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:54 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:55 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.435s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Deleted volume successfully.
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3743bc27-a7f6-4ba2-831b-de4bd067751e tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-dc3cf9b7-790b-47c6-a89b-1e2fba1236f5-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "cinder-262fb367-b28f-443c-b6b0-7e89d118fd9a-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-262fb367-b28f-443c-b6b0-7e89d118fd9a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "cinder-quobyte-262fb367-b28f-443c-b6b0-7e89d118fd9a" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-quobyte-262fb367-b28f-443c-b6b0-7e89d118fd9a" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[513ac16c-f5f3-4ad2-b90f-545df726d40d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:28:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:56 devstack sudo[93285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a
Nov 14 03:28:56 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:56 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a" returned: 0 in 0.611s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:56 devstack sudo[93290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a
Nov 14 03:28:56 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:57 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-262fb367-b28f-443c-b6b0-7e89d118fd9a" returned: 0 in 0.578s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-quobyte-262fb367-b28f-443c-b6b0-7e89d118fd9a" released by "delete_volume" :: held 1.270s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Created reservations ['3eb24444-00bd-411e-940e-4a30e0589950', '1ff75b21-d972-44d3-9969-e8f8761fd6a6', 'bd1f37dd-4fd1-4758-9940-9e37fd37fac8', '0546c7ae-9a19-4d3d-9757-13a131de00e0'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:28:57 devstack sudo[93293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:28:57 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:28:57 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:28:57 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Deleted volume successfully.
Nov 14 03:28:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8b5c220d-7f4b-4837-861f-ecc1e38c73e6 tempest-AttachVolumeNegativeTest-460057857 None] Lock "cinder-262fb367-b28f-443c-b6b0-7e89d118fd9a-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Flow 'volume_create_manager' (931e5a5a-d4ba-492e-a525-a1843d7d17f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5dfc42-1848-49c0-aab0-a4b9182b7ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5dfc42-1848-49c0-aab0-a4b9182b7ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1084479021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09762dc84ca347369505ca37826e3c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:03Z,use_quota=True,user_id='9ce09be2f4974c2d9d0d0d8bae65ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bcb443-dfe5-443a-8a95-6a76698e8571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bcb443-dfe5-443a-8a95-6a76698e8571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24cb6fa-63ba-44fe-ad9d-a0c8be146495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24cb6fa-63ba-44fe-ad9d-a0c8be146495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1', 'volume_name': 'volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531b1142-585f-4e2d-aa07-765da7f463b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531b1142-585f-4e2d-aa07-765da7f463b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae088ec7-1b75-4979-a2bb-dba82ff28baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:02 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Volume cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1', 'volume_size': 1}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1084479021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09762dc84ca347369505ca37826e3c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:03Z,use_quota=True,user_id='9ce09be2f4974c2d9d0d0d8bae65ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Creating volume cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:29:02 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:29:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:02 devstack sudo[93335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 1073741824
Nov 14 03:29:02 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:03 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 1073741824" returned: 0 in 1.227s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:03 devstack sudo[93411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1
Nov 14 03:29:03 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:04 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" returned: 0 in 0.511s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:29:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae088ec7-1b75-4979-a2bb-dba82ff28baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cb5a62-2703-42d9-a22a-dbb008b9368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:04 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Volume volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 (cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1): created successfully
Nov 14 03:29:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cb5a62-2703-42d9-a22a-dbb008b9368b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Flow 'volume_create_manager' (931e5a5a-d4ba-492e-a525-a1843d7d17f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-57e6c68d-a91a-4c64-a003-f5a59449a28e req-3033d5be-588f-4569-983f-759af92a5390 tempest-VolumesSnapshotsTestJSON-1470906292 None] Created volume successfully.
Nov 14 03:29:05 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Creating offline snapshot 14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 of volume cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:29:05 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[965a196f-461e-43b4-a7a5-ad8d065c437b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:29:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:05 devstack sudo[93444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1
Nov 14 03:29:05 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:06 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" returned: 0 in 1.014s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:06 devstack sudo[93451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 1G
Nov 14 03:29:06 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:07 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 1G" returned: 0 in 0.998s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:07 devstack sudo[93473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0
Nov 14 03:29:07 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:08 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0" returned: 0 in 0.992s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:08 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 is being set with open permissions: ugo+rw
Nov 14 03:29:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:08 devstack sudo[93479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0
Nov 14 03:29:08 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:09 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0" returned: 0 in 0.511s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:09 devstack sudo[93482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.info
Nov 14 03:29:09 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:09 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.info" returned: 0 in 0.791s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:09 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.info is being set with open permissions: ugo+rw
Nov 14 03:29:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:09 devstack sudo[93485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.info
Nov 14 03:29:09 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:10 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.info" returned: 0 in 0.613s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.059s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:10 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=75,cinder:DELETE=13,cinder:UPDATE=102,cinder:INSERT=28 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:29:10 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=112,cinder:SELECT=75,cinder:DELETE=7,cinder:INSERT=16 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:29:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-edaccaf0-2214-4e4e-9c6d-0ebe99821b6f req-a039ca27-9aec-46e7-9b04-129e059f2451 tempest-VolumesSnapshotsTestJSON-1470906292 None] Create snapshot completed successfully
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "cinder-14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "cinder-quobyte-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-quobyte-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "cinder-quobyte-14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-quobyte-14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Deleting offline snapshot 14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 of volume cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] snapshot_file for this snap is: volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0874cf-e2c8-466b-99e8-245ec02087cf]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:29:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:11 devstack sudo[93489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0
Nov 14 03:29:11 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:12 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0" returned: 0 in 0.656s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:29:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac02852b-e8a0-4165-aaae-52f523b27974]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:29:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:12 devstack sudo[93495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1
Nov 14 03:29:12 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:12 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" returned: 0 in 0.969s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:13 devstack sudo[93534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0
Nov 14 03:29:13 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:13 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0" returned: 0 in 0.557s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:13 devstack sudo[93540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0
Nov 14 03:29:13 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:14 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1.14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0" returned: 0 in 0.460s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-quobyte-14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0" released by "_delete_snapshot" :: held 2.747s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-quobyte-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" released by "delete_snapshot" :: held 2.788s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG cinder.quota [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Created reservations ['8cf1b0c4-1bb0-476e-856d-c98af3b5e924', '8882fc23-1d4d-4ab0-a8d1-78918c7497e3', '7d9b88ba-6186-4379-9ace-15377ac5aa15', '0faaad3c-50e1-414c-b67b-9cc422fab965'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:29:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Delete snapshot completed successfully.
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-d18dfeb6-af9e-4970-8389-758f30ce59dd req-ed862001-4262-4a3d-a0f0-d20026838c94 tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-14a5876f-cfb0-4c85-8b42-4a7ed84ca1e0-delete_snapshot" released by "delete_snapshot" :: held 2.889s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "cinder-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "cinder-quobyte-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-quobyte-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c108a77-5b8e-4dcf-81aa-5269744e3a87]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:29:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:14 devstack sudo[93563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1
Nov 14 03:29:14 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:15 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" returned: 0 in 0.598s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:15 devstack sudo[93568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1
Nov 14 03:29:15 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:15 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" returned: 0 in 0.445s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-quobyte-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1" released by "delete_volume" :: held 1.087s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG cinder.quota [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Created reservations ['20f26e8b-d13d-4fcc-87cb-6dc45c55f5bd', '0a39124f-5021-4d0a-ad51-baef11d57d9c', 'b8b1e073-24bd-4e5d-8871-0343aac25dc0', 'f7a18912-0d1a-40c5-865c-4a4f27145cda'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:15 devstack sudo[93572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:29:15 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:16 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.488s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:16 devstack cinder-volume[80846]: DEBUG cinder.manager [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:29:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Deleted volume successfully.
Nov 14 03:29:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-4cf9ccf4-b3ff-4d92-a917-adc9a137d868 req-ea46a2f2-63ce-443c-9148-7afb0476c37c tempest-VolumesSnapshotsTestJSON-1470906292 None] Lock "cinder-cc6dd4cd-8c40-4c49-8fc7-bb5e09c63ad1-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Flow 'volume_create_manager' (1ee7ed7e-b3cd-413d-9652-750881811645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a86dba4-f223-4e03-8fd9-264032c0b2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a86dba4-f223-4e03-8fd9-264032c0b2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1026767500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0462ad7b-14f3-474c-8c2e-eafe1ac22e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e9ccb64dd04d7da3f716fb26047aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:20Z,use_quota=True,user_id='e056bfd8867844cf98f6314edb10137f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20dcef3-0566-4ed3-af9b-782d140827d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20dcef3-0566-4ed3-af9b-782d140827d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a372aee-c412-44ab-8eb7-cbaff4657440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a372aee-c412-44ab-8eb7-cbaff4657440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0462ad7b-14f3-474c-8c2e-eafe1ac22e0e', 'volume_name': 'volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbf712b-269d-4288-97c1-9600391c3636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbf712b-269d-4288-97c1-9600391c3636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb35c8b-7f53-43cf-9722-7ecc50881704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:20 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Volume 0462ad7b-14f3-474c-8c2e-eafe1ac22e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e', 'volume_size': 1}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1026767500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0462ad7b-14f3-474c-8c2e-eafe1ac22e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e9ccb64dd04d7da3f716fb26047aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:20Z,use_quota=True,user_id='e056bfd8867844cf98f6314edb10137f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Creating volume 0462ad7b-14f3-474c-8c2e-eafe1ac22e0e {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:29:20 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:29:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:20 devstack sudo[93610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e 1073741824
Nov 14 03:29:20 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:21 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e 1073741824" returned: 0 in 1.063s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:21 devstack sudo[93650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e
Nov 14 03:29:21 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:22 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e" returned: 0 in 0.612s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:29:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb35c8b-7f53-43cf-9722-7ecc50881704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04062659-8b2e-45e5-b3d1-802b1e71a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:22 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Volume volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e (0462ad7b-14f3-474c-8c2e-eafe1ac22e0e): created successfully
Nov 14 03:29:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04062659-8b2e-45e5-b3d1-802b1e71a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Flow 'volume_create_manager' (1ee7ed7e-b3cd-413d-9652-750881811645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:22 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d3e237ae-de6e-4bd4-b1ee-c31087e85c1a tempest-ServerRescueNegativeTestJSON-437985182 None] Created volume successfully.
Nov 14 03:29:28 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Flow 'volume_create_manager' (ce1d4532-2e15-4a7d-9f3b-2956827ec819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d154fc53-b23e-49df-ae6f-aebb5d5027b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d154fc53-b23e-49df-ae6f-aebb5d5027b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-969132681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4cffb2-59a3-42b9-9dad-6efa140cfc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9402d23ba2ca43f58fe11cf85d348e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:28Z,use_quota=True,user_id='52285e8771ad4a16a6d23527e4f77032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6362207b-2b3a-4044-b714-eb948c167c9c),volume_type_id=6362207b-2b3a-4044-b714-eb948c167c9c)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fbeabf-bdee-4daa-a8d1-6a9c15a8bfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fbeabf-bdee-4daa-a8d1-6a9c15a8bfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1175583-c51a-4c5b-bebd-48e0db72d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1175583-c51a-4c5b-bebd-48e0db72d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4cffb2-59a3-42b9-9dad-6efa140cfc5b', 'volume_name': 'volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b514116-eea1-4669-b1e6-5ac71c84d987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b514116-eea1-4669-b1e6-5ac71c84d987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc90776-bca3-42d3-9539-42b29d4f218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:28 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Volume df4cffb2-59a3-42b9-9dad-6efa140cfc5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b', 'volume_size': 1}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-969132681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4cffb2-59a3-42b9-9dad-6efa140cfc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9402d23ba2ca43f58fe11cf85d348e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:28Z,use_quota=True,user_id='52285e8771ad4a16a6d23527e4f77032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6362207b-2b3a-4044-b714-eb948c167c9c),volume_type_id=6362207b-2b3a-4044-b714-eb948c167c9c)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Creating volume df4cffb2-59a3-42b9-9dad-6efa140cfc5b {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:29:28 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:28 devstack sudo[93700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b 1073741824
Nov 14 03:29:28 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:28 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b 1073741824" returned: 0 in 0.601s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:28 devstack sudo[93705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b
Nov 14 03:29:28 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:29 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b" returned: 0 in 0.492s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:29:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc90776-bca3-42d3-9539-42b29d4f218b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132baa5d-bee7-4b3b-84d6-79963baef37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:29 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Volume volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b (df4cffb2-59a3-42b9-9dad-6efa140cfc5b): created successfully
Nov 14 03:29:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132baa5d-bee7-4b3b-84d6-79963baef37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Flow 'volume_create_manager' (ce1d4532-2e15-4a7d-9f3b-2956827ec819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0f669149-b97d-4b08-923f-376b33bab118 tempest-VolumeTypesAccessTest-1724316929 None] Created volume successfully.
Nov 14 03:29:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Acquiring lock "cinder-df4cffb2-59a3-42b9-9dad-6efa140cfc5b-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Lock "cinder-df4cffb2-59a3-42b9-9dad-6efa140cfc5b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Acquiring lock "cinder-quobyte-df4cffb2-59a3-42b9-9dad-6efa140cfc5b" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Lock "cinder-quobyte-df4cffb2-59a3-42b9-9dad-6efa140cfc5b" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6adc74d-501a-41d2-a8f2-dfdfd9a754d4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:29:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:30 devstack sudo[93708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b
Nov 14 03:29:30 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:31 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b" returned: 0 in 0.560s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:31 devstack sudo[93714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b
Nov 14 03:29:31 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:31 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-df4cffb2-59a3-42b9-9dad-6efa140cfc5b" returned: 0 in 0.453s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Lock "cinder-quobyte-df4cffb2-59a3-42b9-9dad-6efa140cfc5b" released by "delete_volume" :: held 1.070s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:31 devstack cinder-volume[80846]: WARNING cinder.quota [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-90690101 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-90690101, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:29:31 devstack cinder-volume[80846]: WARNING cinder.quota [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-90690101 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-90690101, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Created reservations ['cb491671-16ec-4c00-8d01-063381e14255', '5309c9b9-eb8b-4d16-ae55-aa6be5403d06', '2bd8a7aa-5fbb-4399-801d-2e0ec29c9ecd', 'd0f197bb-70cb-4a80-9da4-33f7333d6d6a'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:31 devstack sudo[93742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:29:31 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:32 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.716s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:32 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:29:32 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Deleted volume successfully.
Nov 14 03:29:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-96703227-f226-4291-8dff-490a8c9ffca3 tempest-VolumeTypesAccessTest-1724316929 None] Lock "cinder-df4cffb2-59a3-42b9-9dad-6efa140cfc5b-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:39 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Flow 'volume_create_manager' (3f5abee1-37c5-4fe8-90f2-d880a1a6d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b2b64a-009f-4329-a488-4139060dc46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b2b64a-009f-4329-a488-4139060dc46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2102863071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3287a6c1-b049-4eac-926c-8a0d8dbd0034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e9ccb64dd04d7da3f716fb26047aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:40Z,use_quota=True,user_id='e056bfd8867844cf98f6314edb10137f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3f5792-1529-4b52-9581-286110fd275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3f5792-1529-4b52-9581-286110fd275e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b91837c-a2fc-49d5-b6f2-56e04c2857d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b91837c-a2fc-49d5-b6f2-56e04c2857d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3287a6c1-b049-4eac-926c-8a0d8dbd0034', 'volume_name': 'volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7eb02d4-3bcb-454c-8e0e-3895af1908b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7eb02d4-3bcb-454c-8e0e-3895af1908b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a2789a-b16b-41d8-9dc2-36a191b263bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:39 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Volume 3287a6c1-b049-4eac-926c-8a0d8dbd0034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034', 'volume_size': 1}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2102863071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3287a6c1-b049-4eac-926c-8a0d8dbd0034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e9ccb64dd04d7da3f716fb26047aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:40Z,use_quota=True,user_id='e056bfd8867844cf98f6314edb10137f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Creating volume 3287a6c1-b049-4eac-926c-8a0d8dbd0034 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:29:39 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:29:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:40 devstack sudo[93839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034 1073741824
Nov 14 03:29:40 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:40 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034 1073741824" returned: 0 in 0.872s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:40 devstack sudo[93846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034
Nov 14 03:29:40 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:41 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034" returned: 0 in 0.619s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:29:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a2789a-b16b-41d8-9dc2-36a191b263bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01da520-1603-4ae1-a318-68565f948fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Volume volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034 (3287a6c1-b049-4eac-926c-8a0d8dbd0034): created successfully
Nov 14 03:29:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01da520-1603-4ae1-a318-68565f948fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Flow 'volume_create_manager' (3f5abee1-37c5-4fe8-90f2-d880a1a6d579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-90859363-505a-4487-b79e-f368630e5dcd tempest-ServerRescueNegativeTestJSON-437985182 None] Created volume successfully.
Nov 14 03:29:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:43 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Flow 'volume_create_manager' (25ee41f4-11af-4f0f-af2a-45d935838ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1558b911-44bb-43c6-8fd5-af0abb615c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1558b911-44bb-43c6-8fd5-af0abb615c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1140396413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61ef8f4-a6f7-4c80-b450-8ae3c2fef890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01f0faa6cc244fc9e18aad53072fc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:44Z,use_quota=True,user_id='9f8a2b78ae584e08b93648ea47157730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b1da42-ef09-4124-af3a-d99048cfa075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b1da42-ef09-4124-af3a-d99048cfa075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555aa02c-2abf-4671-ad16-234824e184ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555aa02c-2abf-4671-ad16-234824e184ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61ef8f4-a6f7-4c80-b450-8ae3c2fef890', 'volume_name': 'volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd0f788-b245-4870-8f26-f16a87bc6f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd0f788-b245-4870-8f26-f16a87bc6f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880346af-48f1-4d2b-bd4e-92d4724dca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:44 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Volume f61ef8f4-a6f7-4c80-b450-8ae3c2fef890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890', 'volume_size': 1}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1140396413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61ef8f4-a6f7-4c80-b450-8ae3c2fef890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01f0faa6cc244fc9e18aad53072fc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:44Z,use_quota=True,user_id='9f8a2b78ae584e08b93648ea47157730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Creating volume f61ef8f4-a6f7-4c80-b450-8ae3c2fef890 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:29:44 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:44 devstack sudo[93852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890 1073741824
Nov 14 03:29:44 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:44 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890 1073741824" returned: 0 in 0.808s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:44 devstack sudo[93859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890
Nov 14 03:29:44 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:45 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890" returned: 0 in 0.578s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:29:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880346af-48f1-4d2b-bd4e-92d4724dca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3c2293-346e-4064-b66f-284716d973d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:45 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Volume volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890 (f61ef8f4-a6f7-4c80-b450-8ae3c2fef890): created successfully
Nov 14 03:29:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3c2293-346e-4064-b66f-284716d973d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Flow 'volume_create_manager' (25ee41f4-11af-4f0f-af2a-45d935838ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d64a368b-916f-464e-9927-afc890ceccda tempest-VolumesMetadataTest-589141290 None] Created volume successfully.
Nov 14 03:29:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Acquiring lock "cinder-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Lock "cinder-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:46 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Acquiring lock "cinder-quobyte-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Lock "cinder-quobyte-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:46 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf590c-c0d2-4220-b568-9f1237376569]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:29:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:46 devstack sudo[93877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890
Nov 14 03:29:46 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:47 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890" returned: 0 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:47 devstack sudo[93882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890
Nov 14 03:29:47 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:47 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890" returned: 0 in 0.455s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Lock "cinder-quobyte-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890" released by "delete_volume" :: held 1.151s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:47 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Created reservations ['e1c834bf-74aa-4e23-92fb-abdeaf51152e', '9db7dd15-fc74-4e87-9381-14892cab8202', '8a43c074-de7c-471e-aba0-4721b02e2588', '032eac00-2b10-42ab-9ee3-bc8476a972b3'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:29:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:48 devstack sudo[93885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:29:48 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:48 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.480s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:48 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:29:48 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Deleted volume successfully.
Nov 14 03:29:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e362eae-6625-40b5-af7d-7cb6a5e24e11 tempest-VolumesMetadataTest-589141290 None] Lock "cinder-f61ef8f4-a6f7-4c80-b450-8ae3c2fef890-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Flow 'volume_create_manager' (5b9b521b-5d18-4ca6-95d8-db53a8d4b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ddea1f-4813-412e-a263-839105a823b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ddea1f-4813-412e-a263-839105a823b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-126032699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c13e9d-b89b-446f-8bf5-74b17c866fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd16a7d51c374eceaaf320af00700bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:52Z,use_quota=True,user_id='85194428cef34394937368dc6c8c230c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa58fde-8b27-49cb-abb1-d84e173c7884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa58fde-8b27-49cb-abb1-d84e173c7884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45de7f9b-65e9-4d2c-b38e-1558a01c9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45de7f9b-65e9-4d2c-b38e-1558a01c9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c13e9d-b89b-446f-8bf5-74b17c866fc5', 'volume_name': 'volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d5b80b-b1b7-4977-a1a7-f24b751f8f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d5b80b-b1b7-4977-a1a7-f24b751f8f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c010efc4-4175-4d40-be1e-d520cfdf1d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:52 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Volume 21c13e9d-b89b-446f-8bf5-74b17c866fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5', 'volume_size': 1}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-126032699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c13e9d-b89b-446f-8bf5-74b17c866fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd16a7d51c374eceaaf320af00700bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:29:52Z,use_quota=True,user_id='85194428cef34394937368dc6c8c230c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Creating volume 21c13e9d-b89b-446f-8bf5-74b17c866fc5 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:29:52 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:29:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:52 devstack sudo[93905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5 1073741824
Nov 14 03:29:52 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:53 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5 1073741824" returned: 0 in 0.576s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:53 devstack sudo[93910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5
Nov 14 03:29:53 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:53 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5" returned: 0 in 0.599s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c010efc4-4175-4d40-be1e-d520cfdf1d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12fe28e-791c-427d-af81-75a244ad49d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:29:53 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Volume volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5 (21c13e9d-b89b-446f-8bf5-74b17c866fc5): created successfully
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12fe28e-791c-427d-af81-75a244ad49d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:29:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Flow 'volume_create_manager' (5b9b521b-5d18-4ca6-95d8-db53a8d4b647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:29:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ae01b586-8e4c-466b-bbc6-691d219bd129 tempest-VolumesTransfersV355Test-389477863 None] Created volume successfully.
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:54 devstack sudo[93913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:29:54 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:54 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.510s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:29:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-292d06c2-f5f8-4246-9edb-16ad9b6a89fe tempest-VolumesTransfersV355Test-1947307769 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-292d06c2-f5f8-4246-9edb-16ad9b6a89fe tempest-VolumesTransfersV355Test-1947307769 None] Transfer volume completed successfully.
Nov 14 03:29:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Acquiring lock "cinder-21c13e9d-b89b-446f-8bf5-74b17c866fc5-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Lock "cinder-21c13e9d-b89b-446f-8bf5-74b17c866fc5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Acquiring lock "cinder-quobyte-21c13e9d-b89b-446f-8bf5-74b17c866fc5" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:29:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Lock "cinder-quobyte-21c13e9d-b89b-446f-8bf5-74b17c866fc5" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:29:56 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f96248-8e2e-43a8-b94f-786c2b3d8a0d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:29:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:56 devstack sudo[93921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5
Nov 14 03:29:56 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:57 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5" returned: 0 in 1.452s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:57 devstack sudo[93959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5
Nov 14 03:29:57 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:58 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21c13e9d-b89b-446f-8bf5-74b17c866fc5" returned: 0 in 0.649s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Lock "cinder-quobyte-21c13e9d-b89b-446f-8bf5-74b17c866fc5" released by "delete_volume" :: held 2.141s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Created reservations ['ab9b90e2-6e21-447b-bc01-5adbcb9a4825', '27e6b02c-86aa-4df9-95fa-13b5c3669e18', 'c7941bad-e22b-4446-91d0-59d70352dfe5', 'f5b2eade-a995-4026-8d4c-2e9c2dd17fac'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:29:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:29:58 devstack sudo[93991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:29:58 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:29:59 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root
Nov 14 03:29:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.750s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:29:59 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:29:59 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Deleted volume successfully.
Nov 14 03:29:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-05ee63f5-ddbd-4ea9-a376-49903696fd3c tempest-VolumesTransfersV355Test-659759921 None] Lock "cinder-21c13e9d-b89b-446f-8bf5-74b17c866fc5-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:29:59 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:29:59 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Flow 'volume_create_manager' (3601e5e8-6ef2-4fd6-8015-618e5d2e3a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f057f2-9a5f-4e5d-9949-f5ec469ff221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f057f2-9a5f-4e5d-9949-f5ec469ff221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1357920049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12efe9ff-dea4-42ef-8157-3fb7e0cafde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd16a7d51c374eceaaf320af00700bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:00Z,use_quota=True,user_id='85194428cef34394937368dc6c8c230c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3882148-a046-4e6c-878c-96a6381b9dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3882148-a046-4e6c-878c-96a6381b9dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736b2a9b-c6b3-4720-a7c7-d3cb72de5a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736b2a9b-c6b3-4720-a7c7-d3cb72de5a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12efe9ff-dea4-42ef-8157-3fb7e0cafde5', 'volume_name': 'volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a91d72-3d25-44f6-a4e0-dc8fb5571c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a91d72-3d25-44f6-a4e0-dc8fb5571c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa70a52f-d17f-47e2-a5ce-99decdb97fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:00 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Volume 12efe9ff-dea4-42ef-8157-3fb7e0cafde5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5', 'volume_size': 1}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1357920049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12efe9ff-dea4-42ef-8157-3fb7e0cafde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd16a7d51c374eceaaf320af00700bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:00Z,use_quota=True,user_id='85194428cef34394937368dc6c8c230c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Creating volume 12efe9ff-dea4-42ef-8157-3fb7e0cafde5 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:00 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:00 devstack sudo[93998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5 1073741824
Nov 14 03:30:00 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:00 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5 1073741824" returned: 0 in 0.777s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:00 devstack sudo[94006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5
Nov 14 03:30:00 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:01 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5" returned: 0 in 0.496s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa70a52f-d17f-47e2-a5ce-99decdb97fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687bce97-67ba-40ff-92c9-3a5dfa9440c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:01 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Volume volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5 (12efe9ff-dea4-42ef-8157-3fb7e0cafde5): created successfully
Nov 14 03:30:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687bce97-67ba-40ff-92c9-3a5dfa9440c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Flow 'volume_create_manager' (3601e5e8-6ef2-4fd6-8015-618e5d2e3a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2e84fe9a-8a27-4c7f-abd6-0cf618d53f41 tempest-VolumesTransfersV355Test-389477863 None] Created volume successfully.
Nov 14 03:30:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Acquiring lock "cinder-12efe9ff-dea4-42ef-8157-3fb7e0cafde5-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Lock "cinder-12efe9ff-dea4-42ef-8157-3fb7e0cafde5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Acquiring lock "cinder-quobyte-12efe9ff-dea4-42ef-8157-3fb7e0cafde5" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Lock "cinder-quobyte-12efe9ff-dea4-42ef-8157-3fb7e0cafde5" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:02 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[851ac699-e30d-4370-9456-d4f0e5cdc873]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:02 devstack sudo[94015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5
Nov 14 03:30:02 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:02 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5" returned: 0 in 0.590s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:02 devstack sudo[94020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5
Nov 14 03:30:02 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:03 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12efe9ff-dea4-42ef-8157-3fb7e0cafde5" returned: 0 in 0.481s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Lock "cinder-quobyte-12efe9ff-dea4-42ef-8157-3fb7e0cafde5" released by "delete_volume" :: held 1.100s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Created reservations ['15875011-e5bf-4cbf-b872-963a93457c6c', '9e768600-0a81-4e91-9d01-83af22d33358', 'ec03dcf7-5862-4a79-884e-e72b0437407e', 'ab0ef610-08f1-4f90-b2f4-e5a838ae05fe'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:03 devstack sudo[94023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:03 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:04 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.598s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:04 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Deleted volume successfully.
Nov 14 03:30:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-5cffb6ca-b38a-4a99-882d-9d11b049fc39 tempest-VolumesTransfersV355Test-659759921 None] Lock "cinder-12efe9ff-dea4-42ef-8157-3fb7e0cafde5-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "cinder-07384efe-33b8-4e3f-83c9-de0c5f5251cb-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "cinder-07384efe-33b8-4e3f-83c9-de0c5f5251cb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "cinder-quobyte-07384efe-33b8-4e3f-83c9-de0c5f5251cb" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "cinder-quobyte-07384efe-33b8-4e3f-83c9-de0c5f5251cb" acquired by "delete_volume" :: waited 0.036s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb08e76c-aafc-48e6-9821-69146d2dbd8e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:06 devstack sudo[94033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb
Nov 14 03:30:06 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:07 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb" returned: 0 in 1.112s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:07 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb
Nov 14 03:30:07 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:08 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-07384efe-33b8-4e3f-83c9-de0c5f5251cb" returned: 0 in 1.009s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "cinder-quobyte-07384efe-33b8-4e3f-83c9-de0c5f5251cb" released by "delete_volume" :: held 2.182s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Created reservations ['18674d4d-7c5d-442c-9006-eb9fa4efd1e8', '165d924c-8709-43a8-bb40-7ce4c1f3f6df', '62c19bb7-2be6-46a6-bf8f-1a457297d53d', '17fd27fb-f101-4993-a0a6-fe37bd08bf35'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:08 devstack sudo[94073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:08 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:09 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.743s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:09 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Deleted volume successfully.
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fdb4995b-c12b-4897-8009-ec3d39e6e540 tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "cinder-07384efe-33b8-4e3f-83c9-de0c5f5251cb-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "cinder-bde4656b-334f-43bb-890e-b7781e83cab4-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "cinder-bde4656b-334f-43bb-890e-b7781e83cab4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:09 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "cinder-quobyte-bde4656b-334f-43bb-890e-b7781e83cab4" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "cinder-quobyte-bde4656b-334f-43bb-890e-b7781e83cab4" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f02bc9-cfe3-4196-bcc0-062502fc4c81]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:09 devstack sudo[94081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4
Nov 14 03:30:09 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:10 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Flow 'volume_create_manager' (ad7b47e9-0f21-4c57-a2c5-f3a00e291771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df29ca8-dbe7-4cc8-a7ca-bae153da2a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df29ca8-dbe7-4cc8-a7ca-bae153da2a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-340301398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3bc8c3-830e-4426-b474-1c99842cf0e6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd66cd0a52304ef8b681e1ddfd151bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:10Z,use_quota=True,user_id='f08b39fa66b346b8b1d91d110961dbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fa98de-44c3-474c-8ebe-a2248a5164d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fa98de-44c3-474c-8ebe-a2248a5164d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b23a422-01b3-4588-a2cf-68421eec4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b23a422-01b3-4588-a2cf-68421eec4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3bc8c3-830e-4426-b474-1c99842cf0e6', 'volume_name': 'volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a63462-4ea3-4823-a2b9-6632386475c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a63462-4ea3-4823-a2b9-6632386475c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8981c5-e8e2-49f6-bd82-533ce6ae8b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:10 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Volume 9a3bc8c3-830e-4426-b474-1c99842cf0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6', 'volume_size': 1}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-340301398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3bc8c3-830e-4426-b474-1c99842cf0e6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd66cd0a52304ef8b681e1ddfd151bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:10Z,use_quota=True,user_id='f08b39fa66b346b8b1d91d110961dbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Creating volume 9a3bc8c3-830e-4426-b474-1c99842cf0e6 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:10 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:10 devstack sudo[94085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6 1073741824
Nov 14 03:30:10 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:10 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4" returned: 0 in 1.088s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:10 devstack sudo[94093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4
Nov 14 03:30:10 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:11 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6 1073741824" returned: 0 in 0.930s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:11 devstack sudo[94096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6
Nov 14 03:30:11 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:11 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bde4656b-334f-43bb-890e-b7781e83cab4" returned: 0 in 0.697s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "cinder-quobyte-bde4656b-334f-43bb-890e-b7781e83cab4" released by "delete_volume" :: held 1.880s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=44,cinder:INSERT=13,cinder:UPDATE=73,cinder:DELETE=8 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:DELETE=5,cinder:SELECT=45,cinder:UPDATE=61,cinder:INSERT=15 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Created reservations ['cb3b53e6-c71f-492a-a16b-1b446933d04e', '8730b5a7-8c10-4451-8f70-8cae8d5140f5', 'f16e0f63-e247-4e02-b06b-9bc3c645b390', '8d300f09-40ef-4887-abe0-84026212d062'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:11 devstack sudo[94099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:11 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:12 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6" returned: 0 in 0.798s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8981c5-e8e2-49f6-bd82-533ce6ae8b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66061ce4-4f88-4f90-936c-93a2c8acb36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Volume volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6 (9a3bc8c3-830e-4426-b474-1c99842cf0e6): created successfully
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66061ce4-4f88-4f90-936c-93a2c8acb36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Flow 'volume_create_manager' (ad7b47e9-0f21-4c57-a2c5-f3a00e291771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:12 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f311480b-74de-4e85-a3cf-78ecac58ec55 tempest-VolumesGetTest-1175891270 None] Created volume successfully.
Nov 14 03:30:12 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.910s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:12 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Deleted volume successfully.
Nov 14 03:30:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7047b02b-5cd6-4c78-af6b-70246d89a6ec tempest-AttachVolumeShelveTestJSON-1837662251 None] Lock "cinder-bde4656b-334f-43bb-890e-b7781e83cab4-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Flow 'volume_create_manager' (e9f1775e-62d0-4380-bacd-a9e3a9dcffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cef93f-fab7-47ff-83c2-6a378a6263cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cef93f-fab7-47ff-83c2-6a378a6263cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-533669557',display_name='tempest-VolumesGetTest-Volume-1214008924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e63bae-6399-4340-be50-738e5b2757ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd66cd0a52304ef8b681e1ddfd151bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:13Z,use_quota=True,user_id='f08b39fa66b346b8b1d91d110961dbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d792706f-bf48-46e6-93b6-be1573f40dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d792706f-bf48-46e6-93b6-be1573f40dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9ee421-0d3d-4e03-a7a6-7be810e65c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9ee421-0d3d-4e03-a7a6-7be810e65c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e63bae-6399-4340-be50-738e5b2757ab', 'volume_name': 'volume-48e63bae-6399-4340-be50-738e5b2757ab', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb211ee2-03da-4e56-a7f0-accbe566c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb211ee2-03da-4e56-a7f0-accbe566c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91923709-ee44-46f6-a916-5efb465a1200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Volume 48e63bae-6399-4340-be50-738e5b2757ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e63bae-6399-4340-be50-738e5b2757ab', 'volume_size': 1}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-533669557',display_name='tempest-VolumesGetTest-Volume-1214008924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e63bae-6399-4340-be50-738e5b2757ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd66cd0a52304ef8b681e1ddfd151bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:13Z,use_quota=True,user_id='f08b39fa66b346b8b1d91d110961dbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Creating volume 48e63bae-6399-4340-be50-738e5b2757ab {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:13 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:13 devstack sudo[94103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab 1073741824
Nov 14 03:30:13 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:14 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab 1073741824" returned: 0 in 1.193s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:14 devstack sudo[94109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab
Nov 14 03:30:14 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:15 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab" returned: 0 in 0.869s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91923709-ee44-46f6-a916-5efb465a1200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e63bae-6399-4340-be50-738e5b2757ab', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34874e3e-2a5a-4e64-887e-5873d349cacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:15 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Volume volume-48e63bae-6399-4340-be50-738e5b2757ab (48e63bae-6399-4340-be50-738e5b2757ab): created successfully
Nov 14 03:30:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34874e3e-2a5a-4e64-887e-5873d349cacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Flow 'volume_create_manager' (e9f1775e-62d0-4380-bacd-a9e3a9dcffe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:15 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9dd466ea-a659-4cd8-9349-652de6eb53f8 tempest-VolumesGetTest-1175891270 None] Created volume successfully.
Nov 14 03:30:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Acquiring lock "cinder-48e63bae-6399-4340-be50-738e5b2757ab-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Lock "cinder-48e63bae-6399-4340-be50-738e5b2757ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:16 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Acquiring lock "cinder-quobyte-48e63bae-6399-4340-be50-738e5b2757ab" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Lock "cinder-quobyte-48e63bae-6399-4340-be50-738e5b2757ab" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:16 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d694e7a-619f-4d67-ac81-cecd1d39fa55]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:16 devstack sudo[94114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab
Nov 14 03:30:16 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:17 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab" returned: 0 in 0.630s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:17 devstack sudo[94119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab
Nov 14 03:30:17 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:17 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-48e63bae-6399-4340-be50-738e5b2757ab" returned: 0 in 0.591s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Lock "cinder-quobyte-48e63bae-6399-4340-be50-738e5b2757ab" released by "delete_volume" :: held 1.258s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Created reservations ['ffdbe950-1b20-4e5d-b9f6-69839becc114', '2ef0bd24-febe-4e94-a883-387ddf5d1f5a', 'a635a5ad-a8e2-497e-887a-ce4cb5c59316', '8f14ed00-51d1-49b6-a454-94dfefd51c54'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:17 devstack sudo[94122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:17 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:18 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.485s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:18 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Deleted volume successfully.
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-74dac703-346c-47e8-b767-1ae190c8cc2d tempest-VolumesGetTest-1175891270 None] Lock "cinder-48e63bae-6399-4340-be50-738e5b2757ab-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Acquiring lock "cinder-9a3bc8c3-830e-4426-b474-1c99842cf0e6-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Lock "cinder-9a3bc8c3-830e-4426-b474-1c99842cf0e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Acquiring lock "cinder-quobyte-9a3bc8c3-830e-4426-b474-1c99842cf0e6" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Lock "cinder-quobyte-9a3bc8c3-830e-4426-b474-1c99842cf0e6" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d94e3a-5180-46ca-8722-27786055fbeb]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:19 devstack sudo[94125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6
Nov 14 03:30:19 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:19 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6" returned: 0 in 0.697s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:19 devstack sudo[94131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6
Nov 14 03:30:19 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:20 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9a3bc8c3-830e-4426-b474-1c99842cf0e6" returned: 0 in 0.531s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Lock "cinder-quobyte-9a3bc8c3-830e-4426-b474-1c99842cf0e6" released by "delete_volume" :: held 1.319s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Created reservations ['96b4aec8-e4e5-4ad7-b466-1cda8f0366fd', '8a27244a-edd6-45ca-9a53-66dcb5171cb5', 'baf746ef-03af-4d15-8a57-410287444eb8', 'bcb98f97-d072-4ae3-9bf0-f02c5d25590d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:20 devstack sudo[94134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:20 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:20 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.447s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:20 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Deleted volume successfully.
Nov 14 03:30:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1c3a783c-975a-4204-9b42-a5fdfe7f1baa tempest-VolumesGetTest-1175891270 None] Lock "cinder-9a3bc8c3-830e-4426-b474-1c99842cf0e6-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9e36babc-4964-4559-9d04-6468f744fd46 tempest-BackendsCapabilitiesAdminTestsJSON-2057203327 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 230.98196411132812, 'free_capacity_gb': 230.98196411132812, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80846) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Nov 14 03:30:21 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Flow 'volume_create_manager' (eb3cf27c-0973-4fd6-b43e-fd54aadf44ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670a509e-66b6-4f59-bb6e-f8fdd0effdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670a509e-66b6-4f59-bb6e-f8fdd0effdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-78326491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10b7cd8-8457-4416-920d-fd3a2383b08e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd66cd0a52304ef8b681e1ddfd151bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:22Z,use_quota=True,user_id='f08b39fa66b346b8b1d91d110961dbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcafaa2-91cc-44ba-a680-f4b7caea37af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcafaa2-91cc-44ba-a680-f4b7caea37af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae933843-ee7a-4152-ad42-ac4c2e565ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b96cefe9-6806-4dcc-8eb6-5ec465005bb0 tempest-BackendsCapabilitiesAdminTestsJSON-2057203327 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 230.98196411132812, 'free_capacity_gb': 230.98196411132812, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80846) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae933843-ee7a-4152-ad42-ac4c2e565ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f10b7cd8-8457-4416-920d-fd3a2383b08e', 'volume_name': 'volume-f10b7cd8-8457-4416-920d-fd3a2383b08e', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed275c9390>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f075d3c2-a67e-4e08-bc5e-9a93e805d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f075d3c2-a67e-4e08-bc5e-9a93e805d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d6db3f-7c9a-4f37-bb86-237acda56f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:21 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Volume f10b7cd8-8457-4416-920d-fd3a2383b08e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f10b7cd8-8457-4416-920d-fd3a2383b08e', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed275c9390>}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Cloning f10b7cd8-8457-4416-920d-fd3a2383b08e from image 505e4538-4930-46f5-ae28-a520ed743bcf  at location (None, None). {{(pid=80846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:30:21 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Image download 20.69 MB at 20.69 MB/s
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b6118-5df6-42ea-92da-068e65a1934a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:22 devstack sudo[94177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD
Nov 14 03:30:22 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:22 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:22 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf is fetched for user f08b39fa66b346b8b1d91d110961dbf9. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 14 03:30:22 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d114f99d-6ade-49ff-aa49-0cee6ec8f185]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:22 devstack sudo[94182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD
Nov 14 03:30:22 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:23 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD" returned: 0 in 0.585s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-78326491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10b7cd8-8457-4416-920d-fd3a2383b08e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cd66cd0a52304ef8b681e1ddfd151bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:22Z,use_quota=True,user_id='f08b39fa66b346b8b1d91d110961dbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Creating volume f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:23 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:23 devstack sudo[94187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e 1073741824
Nov 14 03:30:23 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:23 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e 1073741824" returned: 0 in 0.687s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:23 devstack sudo[94195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e
Nov 14 03:30:23 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:24 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:24 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Attempting download of 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume f10b7cd8-8457-4416-920d-fd3a2383b08e. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:30:24 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8478083d-7b63-4a8f-bfd1-8fa574df19cf]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_icbwvojx {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:24 devstack sudo[94208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_icbwvojx
Nov 14 03:30:24 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:25 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_icbwvojx" returned: 0 in 0.669s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_icbwvojx {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:25 devstack sudo[94247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_icbwvojx
Nov 14 03:30:25 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:25 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_icbwvojx" returned: 1 in 0.552s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_icbwvojx' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:30:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ff95e9-9cc1-48f6-8d0d-b1f42fc37fdf]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:25 devstack sudo[94259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD
Nov 14 03:30:25 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9a0266f0-3b4f-4adf-b953-032822eb60db tempest-GroupSnapshotsV319Test-1021759525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9a0266f0-3b4f-4adf-b953-032822eb60db tempest-GroupSnapshotsV319Test-1021759525 None] Group tempest-GroupSnapshotsV319Test-Group-1803716165: creating
Nov 14 03:30:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9a0266f0-3b4f-4adf-b953-032822eb60db tempest-GroupSnapshotsV319Test-1021759525 None] Group tempest-GroupSnapshotsV319Test-Group-1803716165: created successfully
Nov 14 03:30:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9a0266f0-3b4f-4adf-b953-032822eb60db tempest-GroupSnapshotsV319Test-1021759525 None] Create group completed successfully.
Nov 14 03:30:26 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD" returned: 0 in 0.680s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:26 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] 505e4538-4930-46f5-ae28-a520ed743bcf was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:30:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:26 devstack sudo[94267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e
Nov 14 03:30:26 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:27 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e" returned: 0 in 0.943s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_ainy2wcsdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:30:27 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Converted 112.00 MB image at 112.00 MB/s
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:27 devstack sudo[94288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e 1G
Nov 14 03:30:27 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Flow 'volume_create_manager' (deff3737-06e3-4687-9176-ff5b6de73ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2438c609-eec8-4cdc-b8a7-5615ac38c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2438c609-eec8-4cdc-b8a7-5615ac38c05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1348027955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=066aabe9-60cd-4e23-b623-0e62e7342db4,host='devstack@QuobyteHD#QuobyteHD',id=a6327040-42ad-497c-be83-143ecdb4e97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6793d02521174e6a82947ba73f9154cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:28Z,use_quota=True,user_id='9d079cfb5b484a0e8b30da1412a87e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8e73638-2d02-4b97-9e87-011e98d57226),volume_type_id=f8e73638-2d02-4b97-9e87-011e98d57226)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8590f1-b53c-4492-b577-61b9074b6cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8590f1-b53c-4492-b577-61b9074b6cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faca99f9-4da9-45e2-bb3f-2404890bf4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faca99f9-4da9-45e2-bb3f-2404890bf4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6327040-42ad-497c-be83-143ecdb4e97d', 'volume_name': 'volume-a6327040-42ad-497c-be83-143ecdb4e97d', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecb9a74-74ea-4374-bda2-809d3483a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecb9a74-74ea-4374-bda2-809d3483a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534ecca5-8cbe-499f-8c37-00d8ca5f3194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:27 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Volume a6327040-42ad-497c-be83-143ecdb4e97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6327040-42ad-497c-be83-143ecdb4e97d', 'volume_size': 1}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=066aabe9-60cd-4e23-b623-0e62e7342db4,created_at=2025-11-14T02:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1348027955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=066aabe9-60cd-4e23-b623-0e62e7342db4,host='devstack@QuobyteHD#QuobyteHD',id=a6327040-42ad-497c-be83-143ecdb4e97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6793d02521174e6a82947ba73f9154cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:28Z,use_quota=True,user_id='9d079cfb5b484a0e8b30da1412a87e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8e73638-2d02-4b97-9e87-011e98d57226),volume_type_id=f8e73638-2d02-4b97-9e87-011e98d57226)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Creating volume a6327040-42ad-497c-be83-143ecdb4e97d {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:27 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:27 devstack sudo[94291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d 1073741824
Nov 14 03:30:27 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:28 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e 1G" returned: 0 in 0.599s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ed2bd-e4bc-4ee0-a770-924861dd4ecd]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:28 devstack sudo[94298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e
Nov 14 03:30:28 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:28 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d 1073741824" returned: 0 in 0.658s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:28 devstack sudo[94301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d
Nov 14 03:30:28 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:28 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e" returned: 0 in 0.617s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:28 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d" returned: 0 in 0.493s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534ecca5-8cbe-499f-8c37-00d8ca5f3194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6327040-42ad-497c-be83-143ecdb4e97d', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:28 devstack sudo[94305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e
Nov 14 03:30:28 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dccaecd-fdb9-4b99-824a-806cca087a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:28 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Volume volume-a6327040-42ad-497c-be83-143ecdb4e97d (a6327040-42ad-497c-be83-143ecdb4e97d): created successfully
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dccaecd-fdb9-4b99-824a-806cca087a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Flow 'volume_create_manager' (deff3737-06e3-4687-9176-ff5b6de73ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:28 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-61e4d259-eb85-49bc-a9d3-8404b27069fc tempest-GroupSnapshotsV319Test-1021759525 None] Created volume successfully.
Nov 14 03:30:29 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e" returned: 1 in 0.577s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Downloaded image 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume f10b7cd8-8457-4416-920d-fd3a2383b08e successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf for user f08b39fa66b346b8b1d91d110961dbf9 is deleted. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Marking volume f10b7cd8-8457-4416-920d-fd3a2383b08e as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Copying metadata from image 505e4538-4930-46f5-ae28-a520ed743bcf to f10b7cd8-8457-4416-920d-fd3a2383b08e. {{(pid=80846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Creating volume glance metadata for volume f10b7cd8-8457-4416-920d-fd3a2383b08e backed by image 505e4538-4930-46f5-ae28-a520ed743bcf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d6db3f-7c9a-4f37-bb86-237acda56f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10b7cd8-8457-4416-920d-fd3a2383b08e', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed275c9390>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f507402-ccc5-42fb-bcc4-8e04fbe5a8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:29 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Volume volume-f10b7cd8-8457-4416-920d-fd3a2383b08e (f10b7cd8-8457-4416-920d-fd3a2383b08e): created successfully
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f507402-ccc5-42fb-bcc4-8e04fbe5a8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Flow 'volume_create_manager' (eb3cf27c-0973-4fd6-b43e-fd54aadf44ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-566260bd-8570-4b8a-9da8-c34a59ff2c53 tempest-VolumesGetTest-1175891270 None] Created volume successfully.
Nov 14 03:30:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] GroupSnapshot d3865aad-b964-43b7-8adb-ca61e5613a1e: creating.
Nov 14 03:30:29 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Group snapshot d3865aad-b964-43b7-8adb-ca61e5613a1e: creating. {{(pid=80846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Creating offline snapshot d88cbb60-b07c-4555-a7d0-79731298de21 of volume a6327040-42ad-497c-be83-143ecdb4e97d {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed6e1f-171a-48f5-be2f-6f626d350fbb]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:30 devstack sudo[94311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d
Nov 14 03:30:30 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:30 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d" returned: 0 in 0.657s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:30 devstack sudo[94317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 1G
Nov 14 03:30:30 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Flow 'volume_create_manager' (f1858fc4-5812-4f3d-ad50-e79e88033100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79737b9-d008-4b34-b21c-27d0ab2618c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79737b9-d008-4b34-b21c-27d0ab2618c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-480004854',display_name='tempest-VolumesGetTest-Volume-167194287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd66cd0a52304ef8b681e1ddfd151bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:31Z,use_quota=True,user_id='f08b39fa66b346b8b1d91d110961dbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9d0670-4bb2-474b-8cf0-17129f7ad87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9d0670-4bb2-474b-8cf0-17129f7ad87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcd001a-46b8-4ece-95ce-ed0c5ba3bd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcd001a-46b8-4ece-95ce-ed0c5ba3bd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab', 'volume_name': 'volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684ddcd0-2fc1-4164-8cde-285fb5c9c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684ddcd0-2fc1-4164-8cde-285fb5c9c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4d5634-3ce6-4f1a-ae75-d0799c2a235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:30 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Volume c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab', 'volume_size': 1}
Nov 14 03:30:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:31 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 1G" returned: 0 in 0.520s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6327040-42ad-497c-be83-143ecdb4e97d -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:31 devstack sudo[94322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6327040-42ad-497c-be83-143ecdb4e97d -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21
Nov 14 03:30:31 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:31 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6327040-42ad-497c-be83-143ecdb4e97d -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21" returned: 0 in 0.468s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:31 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:30:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:31 devstack sudo[94327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21
Nov 14 03:30:31 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:32 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21" returned: 0 in 0.456s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:32 devstack sudo[94330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.info
Nov 14 03:30:32 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:32 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.info" returned: 0 in 0.477s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:32 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:30:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:32 devstack sudo[94333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.info
Nov 14 03:30:32 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:33 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.info" returned: 0 in 0.499s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.115s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.371s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-480004854',display_name='tempest-VolumesGetTest-Volume-167194287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd66cd0a52304ef8b681e1ddfd151bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:31Z,use_quota=True,user_id='f08b39fa66b346b8b1d91d110961dbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Creating volume c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:33 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:33 devstack sudo[94336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab 1073741824
Nov 14 03:30:33 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-aacd75d1-7a91-473a-88bf-a0b97d8caf1e tempest-GroupSnapshotsV319Test-1021759525 None] group_snapshot d3865aad-b964-43b7-8adb-ca61e5613a1e: created successfully
Nov 14 03:30:33 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab 1073741824" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:33 devstack sudo[94341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab
Nov 14 03:30:33 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:34 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab" returned: 0 in 0.420s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4d5634-3ce6-4f1a-ae75-d0799c2a235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbf6257-ca17-4e47-bfc7-5a0fe182e33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:34 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Volume volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab (c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab): created successfully
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbf6257-ca17-4e47-bfc7-5a0fe182e33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Flow 'volume_create_manager' (f1858fc4-5812-4f3d-ad50-e79e88033100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:34 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-dec89c1b-1ad7-4ef2-9837-bc5814365050 tempest-VolumesGetTest-1175891270 None] Created volume successfully.
Nov 14 03:30:34 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] group_snapshot d3865aad-b964-43b7-8adb-ca61e5613a1e: deleting
Nov 14 03:30:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] group_snapshot d3865aad-b964-43b7-8adb-ca61e5613a1e: deleting {{(pid=80846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Acquiring lock "cinder-quobyte-a6327040-42ad-497c-be83-143ecdb4e97d" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Lock "cinder-quobyte-a6327040-42ad-497c-be83-143ecdb4e97d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Acquiring lock "cinder-quobyte-d88cbb60-b07c-4555-a7d0-79731298de21" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Lock "cinder-quobyte-d88cbb60-b07c-4555-a7d0-79731298de21" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Deleting offline snapshot d88cbb60-b07c-4555-a7d0-79731298de21 of volume a6327040-42ad-497c-be83-143ecdb4e97d {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] snapshot_file for this snap is: volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6aa860-d496-4984-930f-36eea51e62f3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:34 devstack sudo[94344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21
Nov 14 03:30:34 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Acquiring lock "cinder-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Lock "cinder-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Acquiring lock "cinder-quobyte-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Lock "cinder-quobyte-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77fe433-9844-4d93-b2a8-936d12ebf982]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:35 devstack sudo[94346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab
Nov 14 03:30:35 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:35 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21" returned: 0 in 0.769s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6327040-42ad-497c-be83-143ecdb4e97d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebd3c66-450c-4a17-97d3-f5f729bee3fc]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:35 devstack sudo[94351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d
Nov 14 03:30:35 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:35 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab" returned: 0 in 0.608s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:35 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab
Nov 14 03:30:35 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:35 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d" returned: 0 in 0.598s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:35 devstack sudo[94361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21
Nov 14 03:30:35 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:36 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab" returned: 0 in 0.473s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Lock "cinder-quobyte-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab" released by "delete_volume" :: held 1.105s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Created reservations ['f383c94b-799f-44bb-95c6-858ce96a374b', 'ca095877-2ab2-4875-bca0-a00d55ffb817', '7abd8278-2e2f-4001-a380-53d14b673387', 'e8d523c0-82da-4206-9e4e-1686c6b53b4c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:36 devstack sudo[94364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:36 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:36 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21" returned: 0 in 0.532s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:36 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21
Nov 14 03:30:36 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:36 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.460s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:36 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Deleted volume successfully.
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1268e735-686b-4c40-affa-f822826241e8 tempest-VolumesGetTest-1175891270 None] Lock "cinder-c5c54c62-db1e-4b1e-8d4e-02777a7ba9ab-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:36 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d.d88cbb60-b07c-4555-a7d0-79731298de21" returned: 0 in 0.451s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Lock "cinder-quobyte-d88cbb60-b07c-4555-a7d0-79731298de21" released by "_delete_snapshot" :: held 2.447s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Lock "cinder-quobyte-a6327040-42ad-497c-be83-143ecdb4e97d" released by "delete_snapshot" :: held 2.461s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:36 devstack cinder-volume[80846]: WARNING cinder.quota [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1183061676 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1183061676, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:30:36 devstack cinder-volume[80846]: WARNING cinder.quota [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1183061676 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1183061676, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:30:36 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] Created reservations ['e99a2aff-a028-4156-a1d6-391740a0cd35', '9cfbde31-a3d4-4dae-b16f-7808605a8d92', 'a7360088-717a-447f-931c-778e7e696b0c', '20067685-be10-473e-b341-2ae68da57043'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:36 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c269e150-15ae-47aa-b37d-c591473b3839 tempest-GroupSnapshotsV319Test-1021759525 None] group_snapshot d3865aad-b964-43b7-8adb-ca61e5613a1e: deleted successfully
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Acquiring lock "cinder-f10b7cd8-8457-4416-920d-fd3a2383b08e-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Lock "cinder-f10b7cd8-8457-4416-920d-fd3a2383b08e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:37 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Acquiring lock "cinder-quobyte-f10b7cd8-8457-4416-920d-fd3a2383b08e" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Lock "cinder-quobyte-f10b7cd8-8457-4416-920d-fd3a2383b08e" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7c1e6-e569-4c9c-bdb9-005aa108dd53]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:37 devstack sudo[94373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e
Nov 14 03:30:37 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:37 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Acquiring lock "cinder-quobyte-a6327040-42ad-497c-be83-143ecdb4e97d" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Lock "cinder-quobyte-a6327040-42ad-497c-be83-143ecdb4e97d" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3df2a2d-11a6-484d-a38a-2c8f2da5ee98]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:37 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e" returned: 0 in 0.636s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:37 devstack sudo[94377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d
Nov 14 03:30:37 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:37 devstack sudo[94378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e
Nov 14 03:30:37 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:38 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d" returned: 0 in 0.591s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:38 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e" returned: 1 in 0.538s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:38 devstack sudo[94387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d
Nov 14 03:30:38 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:38 devstack sudo[94388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e
Nov 14 03:30:38 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:38 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f10b7cd8-8457-4416-920d-fd3a2383b08e" returned: 0 in 0.439s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Lock "cinder-quobyte-f10b7cd8-8457-4416-920d-fd3a2383b08e" released by "delete_volume" :: held 1.680s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:38 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a6327040-42ad-497c-be83-143ecdb4e97d" returned: 0 in 0.487s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Lock "cinder-quobyte-a6327040-42ad-497c-be83-143ecdb4e97d" released by "delete_volume" :: held 1.128s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Created reservations ['24b7493b-068d-41c7-9290-c91b2c4e1920', '1177965b-9fee-4062-a10e-7fb2b960190c', '427afebb-6390-4371-99cc-9043bfadc6db', '5d3028c4-ac01-4333-8125-daac8ccab716'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:38 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Created reservations ['979d80f3-7f89-4df8-a63a-85842bf597f0'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:38 devstack sudo[94393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:38 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:39 devstack cinder-volume[80846]: WARNING cinder.quota [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1183061676 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1183061676, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Created reservations ['73de6afb-1ac2-4425-94ad-7fca80a29c2c', 'f5e8744d-c50e-4c31-be5b-fdac589e0771', '873eeb72-9812-40b8-bd0f-e1c4719f0c70', 'ecf049b2-cbcd-4d97-8848-296deaa7a144'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:39 devstack sudo[94395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:39 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:39 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.486s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:39 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Deleted volume successfully.
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d1a92754-8c43-4a4d-b17d-317feef1813d tempest-VolumesGetTest-1175891270 None] Lock "cinder-f10b7cd8-8457-4416-920d-fd3a2383b08e-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:39 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.471s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:39 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:39 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7b5c4428-2c35-4d36-b2e8-cbc0870bd377 tempest-GroupSnapshotsV319Test-1021759525 None] Delete group completed successfully.
Nov 14 03:30:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Flow 'volume_create_manager' (cba631d9-e4ed-4f90-b65b-83e508b1565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c708f8b-9e7b-47eb-adbb-5634eeb53ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c708f8b-9e7b-47eb-adbb-5634eeb53ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1014329537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9a74ac-36ef-4bbd-9992-eb756c753f07,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a5611eefa74db6a769c8a636b15b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:41Z,use_quota=True,user_id='cd1738d74669428bb41ea3b6456756aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183e0e45-2700-456e-a78b-b76cdedb243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183e0e45-2700-456e-a78b-b76cdedb243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1256e3e0-a52c-4f7c-a5dd-c430ad3b29a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1256e3e0-a52c-4f7c-a5dd-c430ad3b29a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9a74ac-36ef-4bbd-9992-eb756c753f07', 'volume_name': 'volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e352b71d-fb76-478c-83a2-bdb6971a61dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e352b71d-fb76-478c-83a2-bdb6971a61dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b90b7c-60bf-4170-9e0c-8d986ad57f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Volume 1b9a74ac-36ef-4bbd-9992-eb756c753f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07', 'volume_size': 1}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1014329537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9a74ac-36ef-4bbd-9992-eb756c753f07,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a5611eefa74db6a769c8a636b15b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:41Z,use_quota=True,user_id='cd1738d74669428bb41ea3b6456756aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Creating volume 1b9a74ac-36ef-4bbd-9992-eb756c753f07 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:41 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:41 devstack sudo[94407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07 1073741824
Nov 14 03:30:41 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:42 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07 1073741824" returned: 0 in 0.669s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:42 devstack sudo[94412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07
Nov 14 03:30:42 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:42 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07" returned: 0 in 0.548s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b90b7c-60bf-4170-9e0c-8d986ad57f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382d6636-3e90-4d7c-94fa-f52e20e2bdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:42 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Volume volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07 (1b9a74ac-36ef-4bbd-9992-eb756c753f07): created successfully
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382d6636-3e90-4d7c-94fa-f52e20e2bdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Flow 'volume_create_manager' (cba631d9-e4ed-4f90-b65b-83e508b1565c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:42 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-14ce6234-b307-4e14-8317-8d2b3bd7386f tempest-VolumesListTestJSON-154697148 None] Created volume successfully.
Nov 14 03:30:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Flow 'volume_create_manager' (8dab0b91-fa8b-4c3e-961f-3cc0665c71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c6b174-d73b-449c-9aa0-55aca3a031f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c6b174-d73b-449c-9aa0-55aca3a031f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1096145513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859707d1-17e1-40aa-98b0-fec5dc4b954f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a5611eefa74db6a769c8a636b15b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:44Z,use_quota=True,user_id='cd1738d74669428bb41ea3b6456756aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6bf1b4-2e08-44b1-9c24-bef1d46be14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6bf1b4-2e08-44b1-9c24-bef1d46be14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bf4111-5936-469e-b8b0-dac6dba83287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bf4111-5936-469e-b8b0-dac6dba83287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859707d1-17e1-40aa-98b0-fec5dc4b954f', 'volume_name': 'volume-859707d1-17e1-40aa-98b0-fec5dc4b954f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c9658e-cfb8-4231-bfb2-b89deefd4da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c9658e-cfb8-4231-bfb2-b89deefd4da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b63e34-26fc-4afd-bb71-500cade5d608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:43 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Volume 859707d1-17e1-40aa-98b0-fec5dc4b954f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859707d1-17e1-40aa-98b0-fec5dc4b954f', 'volume_size': 1}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1096145513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859707d1-17e1-40aa-98b0-fec5dc4b954f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a5611eefa74db6a769c8a636b15b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:44Z,use_quota=True,user_id='cd1738d74669428bb41ea3b6456756aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Creating volume 859707d1-17e1-40aa-98b0-fec5dc4b954f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:43 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:43 devstack sudo[94418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f 1073741824
Nov 14 03:30:43 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:44 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f 1073741824" returned: 0 in 0.619s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:44 devstack sudo[94425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f
Nov 14 03:30:44 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:45 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f" returned: 0 in 0.534s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b63e34-26fc-4afd-bb71-500cade5d608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859707d1-17e1-40aa-98b0-fec5dc4b954f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4dcec-5ab2-4260-b89c-1eee5d382c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:45 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Volume volume-859707d1-17e1-40aa-98b0-fec5dc4b954f (859707d1-17e1-40aa-98b0-fec5dc4b954f): created successfully
Nov 14 03:30:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4dcec-5ab2-4260-b89c-1eee5d382c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Flow 'volume_create_manager' (8dab0b91-fa8b-4c3e-961f-3cc0665c71b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-822393a3-6749-481d-95db-ee953a0530b0 tempest-VolumesListTestJSON-154697148 None] Created volume successfully.
Nov 14 03:30:46 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Flow 'volume_create_manager' (8a6cf4e6-d07f-4023-800f-7e792d6bb605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11488f00-aac2-47ab-9a46-5424abd10fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11488f00-aac2-47ab-9a46-5424abd10fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-452606001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce0a627-c462-46d9-ac98-1c4f4b59b2fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a5611eefa74db6a769c8a636b15b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:46Z,use_quota=True,user_id='cd1738d74669428bb41ea3b6456756aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739d5298-75ff-44f0-90fd-0b6161451d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739d5298-75ff-44f0-90fd-0b6161451d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96864005-2865-4777-bfac-db9046b4c797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96864005-2865-4777-bfac-db9046b4c797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce0a627-c462-46d9-ac98-1c4f4b59b2fc', 'volume_name': 'volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0129d69-8d01-404a-86d9-a4d808ad9e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0129d69-8d01-404a-86d9-a4d808ad9e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d9bcd2-e6d0-4340-be1f-aa71d530d502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:46 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Volume 4ce0a627-c462-46d9-ac98-1c4f4b59b2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc', 'volume_size': 1}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-452606001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce0a627-c462-46d9-ac98-1c4f4b59b2fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a5611eefa74db6a769c8a636b15b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:46Z,use_quota=True,user_id='cd1738d74669428bb41ea3b6456756aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Creating volume 4ce0a627-c462-46d9-ac98-1c4f4b59b2fc {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:46 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:46 devstack sudo[94437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc 1073741824
Nov 14 03:30:46 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:47 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc 1073741824" returned: 0 in 0.591s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:47 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc
Nov 14 03:30:47 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:47 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc" returned: 0 in 0.585s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d9bcd2-e6d0-4340-be1f-aa71d530d502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2867e7aa-cfae-462d-8c2d-9ad41c99fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:47 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Flow 'volume_create_manager' (9579f801-c0f7-4f50-ac79-1bfb98ffe36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8939c3ac-b872-4ee1-be60-626653e0f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:47 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Volume volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc (4ce0a627-c462-46d9-ac98-1c4f4b59b2fc): created successfully
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2867e7aa-cfae-462d-8c2d-9ad41c99fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Flow 'volume_create_manager' (8a6cf4e6-d07f-4023-800f-7e792d6bb605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8939c3ac-b872-4ee1-be60-626653e0f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-232750010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625a9390-bf9e-4f16-a319-b5f580261077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0135334a91d542b0bd3176e89dffda0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:48Z,use_quota=True,user_id='760e4621ab994fcaa9213f8724b982fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f698f33-60de-40d7-9109-94dfa567f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f698f33-60de-40d7-9109-94dfa567f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd42d5e-b791-4b30-bd42-d6576a87ee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd42d5e-b791-4b30-bd42-d6576a87ee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625a9390-bf9e-4f16-a319-b5f580261077', 'volume_name': 'volume-625a9390-bf9e-4f16-a319-b5f580261077', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a0aac1-8608-4b2e-ba65-56d9498dce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a0aac1-8608-4b2e-ba65-56d9498dce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9830fa-3afe-4df5-a66e-fe765630483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:47 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Volume 625a9390-bf9e-4f16-a319-b5f580261077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625a9390-bf9e-4f16-a319-b5f580261077', 'volume_size': 1}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-232750010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625a9390-bf9e-4f16-a319-b5f580261077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0135334a91d542b0bd3176e89dffda0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:48Z,use_quota=True,user_id='760e4621ab994fcaa9213f8724b982fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Creating volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:47 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a552c096-765d-4aea-939c-7dad135f3f68 tempest-VolumesListTestJSON-154697148 None] Created volume successfully.
Nov 14 03:30:47 devstack sudo[94449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077 1073741824
Nov 14 03:30:47 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:48 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077 1073741824" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:48 devstack sudo[94454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077
Nov 14 03:30:48 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:48 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077" returned: 0 in 0.506s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9830fa-3afe-4df5-a66e-fe765630483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625a9390-bf9e-4f16-a319-b5f580261077', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ae5de9-9923-4d54-be2d-40aab21c4e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:48 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Volume volume-625a9390-bf9e-4f16-a319-b5f580261077 (625a9390-bf9e-4f16-a319-b5f580261077): created successfully
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ae5de9-9923-4d54-be2d-40aab21c4e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Flow 'volume_create_manager' (9579f801-c0f7-4f50-ac79-1bfb98ffe36c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:48 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0f86114d-16f4-4d35-8eb3-8e28c2f16fce tempest-SnapshotsActionsTest-1843356364 None] Created volume successfully.
Nov 14 03:30:49 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Creating offline snapshot 24d49390-be79-4874-9cb7-ef31df7466b0 of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:30:49 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[35771c10-ed53-4b80-970f-138f4722e9d1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:50 devstack sudo[94457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077
Nov 14 03:30:50 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "cinder-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:50 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "cinder-quobyte-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-quobyte-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f217803c-30d1-400e-a3ec-293f86ad44c2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:50 devstack sudo[94459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc
Nov 14 03:30:50 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:50 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077" returned: 0 in 0.662s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:50 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 1G
Nov 14 03:30:50 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:50 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc" returned: 0 in 0.545s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:50 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc
Nov 14 03:30:50 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:51 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 1G" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:51 devstack sudo[94481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:30:51 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:51 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc" returned: 0 in 0.429s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-quobyte-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc" released by "delete_volume" :: held 1.021s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Created reservations ['64f6c756-0608-477a-8bd1-376c9db2131b', '551ceb0f-cdbc-4515-9e6b-d0f37cd9ecf6', 'c857e5f5-b203-4bb3-bd04-3bc24318fa70', 'e244963d-9706-4813-a39e-7a546a485b5f'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:51 devstack sudo[94484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:51 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:51 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.469s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:51 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 is being set with open permissions: ugo+rw
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:51 devstack sudo[94489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:30:51 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:51 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.438s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Deleted volume successfully.
Nov 14 03:30:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e98ad2a8-77cb-4f4a-bc92-eaf5f3a149d1 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-4ce0a627-c462-46d9-ac98-1c4f4b59b2fc-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:52 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.445s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:52 devstack sudo[94493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.info
Nov 14 03:30:52 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "cinder-859707d1-17e1-40aa-98b0-fec5dc4b954f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-859707d1-17e1-40aa-98b0-fec5dc4b954f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:52 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "cinder-quobyte-859707d1-17e1-40aa-98b0-fec5dc4b954f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.info" returned: 0 in 0.525s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:52 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.info is being set with open permissions: ugo+rw
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-quobyte-859707d1-17e1-40aa-98b0-fec5dc4b954f" acquired by "delete_volume" :: waited 0.025s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:52 devstack sudo[94496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.info
Nov 14 03:30:52 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a0279b-06fb-400d-8bb2-9e0ce4680117]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:52 devstack sudo[94498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f
Nov 14 03:30:52 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:53 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.info" returned: 0 in 0.463s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.147s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4af90a25-face-4960-9e6a-fa352f75e994 tempest-SnapshotsActionsTest-1843356364 None] Create snapshot completed successfully
Nov 14 03:30:53 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f" returned: 0 in 0.593s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:53 devstack sudo[94504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f
Nov 14 03:30:53 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:53 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-859707d1-17e1-40aa-98b0-fec5dc4b954f" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-quobyte-859707d1-17e1-40aa-98b0-fec5dc4b954f" released by "delete_volume" :: held 1.105s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Created reservations ['8de8dbed-3439-4574-a99e-2f98bb7b95dd', '5ae9e257-986f-4d3e-b660-3b70506dd7b6', '596efb23-71b6-4dbc-91ce-dc5d308c8ae6', 'a638ab74-b118-4971-bdaf-093a3e0d6a71'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:53 devstack sudo[94507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:53 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:54 devstack sudo[94509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:54 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:54 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.505s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:54 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Deleted volume successfully.
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0b9169b4-6762-414a-96f2-04a512660fb7 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-859707d1-17e1-40aa-98b0-fec5dc4b954f-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:54 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Creating offline snapshot a8cee621-644b-4f2f-996d-39ff8c000f40 of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e214d-bcf9-4f64-89ac-46be798fd965]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:54 devstack sudo[94512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:30:54 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:54 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.486s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "cinder-1b9a74ac-36ef-4bbd-9992-eb756c753f07-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-1b9a74ac-36ef-4bbd-9992-eb756c753f07-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:54 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "cinder-quobyte-1b9a74ac-36ef-4bbd-9992-eb756c753f07" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-quobyte-1b9a74ac-36ef-4bbd-9992-eb756c753f07" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03a4f7a-d65f-48ca-830c-9edca2876182]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:55 devstack sudo[94516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07
Nov 14 03:30:55 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:55 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.614s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:55 devstack sudo[94521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 1G
Nov 14 03:30:55 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:55 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07" returned: 0 in 0.567s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:55 devstack sudo[94526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07
Nov 14 03:30:55 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:55 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 1G" returned: 0 in 0.545s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:55 devstack sudo[94531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40
Nov 14 03:30:55 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:55 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b9a74ac-36ef-4bbd-9992-eb756c753f07" returned: 0 in 0.472s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-quobyte-1b9a74ac-36ef-4bbd-9992-eb756c753f07" released by "delete_volume" :: held 1.072s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:55 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Created reservations ['67d498ef-6ed7-49d5-b57d-89aefe855171', '65733713-ef62-48ab-b157-a83df93c0936', 'f7ffaf7d-6bcc-408c-bffa-3827c517da45', 'f0df86fa-dedc-40ea-a83c-a0872db64f56'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:56 devstack sudo[94534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:30:56 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:56 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40" returned: 0 in 0.481s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:56 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 is being set with open permissions: ugo+rw
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:56 devstack sudo[94539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40
Nov 14 03:30:56 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:56 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.448s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:30:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Deleted volume successfully.
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3dc135fc-3540-466f-a200-afbb7a756562 tempest-VolumesListTestJSON-154697148 None] Lock "cinder-1b9a74ac-36ef-4bbd-9992-eb756c753f07-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:56 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40" returned: 0 in 0.444s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3eda4f04-8c72-47ff-bdfe-123447d2551c tempest-SnapshotsActionsTest-1843356364 None] Create snapshot completed successfully
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-a8cee621-644b-4f2f-996d-39ff8c000f40-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-a8cee621-644b-4f2f-996d-39ff8c000f40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-quobyte-a8cee621-644b-4f2f-996d-39ff8c000f40" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-a8cee621-644b-4f2f-996d-39ff8c000f40" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Deleting offline snapshot a8cee621-644b-4f2f-996d-39ff8c000f40 of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] snapshot_file for this snap is: volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[580649b7-8fd0-442b-9aa6-050da5ac48f7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:57 devstack sudo[94543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40
Nov 14 03:30:57 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:58 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40" returned: 0 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b19a74-2e49-459f-a386-c1d728fe73dc]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:58 devstack sudo[94548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:30:58 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:58 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Flow 'volume_create_manager' (34749cbe-a461-4b6f-a111-23f4e687efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b1efb0-69f0-4a6b-bf77-6f2dedb46016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b1efb0-69f0-4a6b-bf77-6f2dedb46016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1665746651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338bc6d3-03ff-445f-9a38-d869f4bd00ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3686a5601da94a9585c9f4a876c4b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:59Z,use_quota=True,user_id='29aed298a6834d118c02cdddd1a9551f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cf4522-5c35-4caf-a16e-5a6ddbc375a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cf4522-5c35-4caf-a16e-5a6ddbc375a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6648f9-5804-4a62-a8c0-6b5d2725aeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6648f9-5804-4a62-a8c0-6b5d2725aeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '338bc6d3-03ff-445f-9a38-d869f4bd00ad', 'volume_name': 'volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5dce98-f8b0-4d60-b137-01331762246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5dce98-f8b0-4d60-b137-01331762246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbd7638-2422-41d3-a562-689d67de15d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:58 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Volume 338bc6d3-03ff-445f-9a38-d869f4bd00ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad', 'volume_size': 1}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1665746651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338bc6d3-03ff-445f-9a38-d869f4bd00ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3686a5601da94a9585c9f4a876c4b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:30:59Z,use_quota=True,user_id='29aed298a6834d118c02cdddd1a9551f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Creating volume 338bc6d3-03ff-445f-9a38-d869f4bd00ad {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:30:58 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:58 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad 1073741824
Nov 14 03:30:58 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:58 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.579s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:30:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:59 devstack sudo[94555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40
Nov 14 03:30:59 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:59 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad 1073741824" returned: 0 in 0.528s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:59 devstack sudo[94560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad
Nov 14 03:30:59 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:59 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40" returned: 0 in 0.503s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:30:59 devstack sudo[94565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40
Nov 14 03:30:59 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:30:59 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad" returned: 0 in 0.469s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbd7638-2422-41d3-a562-689d67de15d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2265a75-9081-4f7b-b5c4-ec7a35e89f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:30:59 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Volume volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad (338bc6d3-03ff-445f-9a38-d869f4bd00ad): created successfully
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2265a75-9081-4f7b-b5c4-ec7a35e89f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Flow 'volume_create_manager' (34749cbe-a461-4b6f-a111-23f4e687efb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:30:59 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c09432ae-3b11-4082-ad21-e1c2dd495afd tempest-VolumesNegativeTest-342890874 None] Created volume successfully.
Nov 14 03:30:59 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.a8cee621-644b-4f2f-996d-39ff8c000f40" returned: 0 in 0.462s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-a8cee621-644b-4f2f-996d-39ff8c000f40" released by "_delete_snapshot" :: held 2.259s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:30:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" released by "delete_snapshot" :: held 2.271s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:00 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Created reservations ['afebc486-8210-4c74-ae53-406ca118d6d9', '08b2bb71-8968-4551-aa02-18679de21082', 'fb61f5e8-96f0-4061-aae3-283d36422b7b', '78d87def-ed55-4806-b4a2-8aadf76d13c0'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:31:00 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Delete snapshot completed successfully.
Nov 14 03:31:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6ec59544-b095-4325-b92c-7aacafabf9bb tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-a8cee621-644b-4f2f-996d-39ff8c000f40-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:01 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Creating offline snapshot 90e2ef0f-b80c-4533-b980-0352a97b632a of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:31:01 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9a607d-f225-4cf8-ab61-dbf59ad06b0b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:01 devstack sudo[94570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:01 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:01 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.587s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:01 devstack sudo[94577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a 1G
Nov 14 03:31:01 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:02 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a 1G" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:02 devstack sudo[94582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a
Nov 14 03:31:02 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:02 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a" returned: 0 in 0.499s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:02 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a is being set with open permissions: ugo+rw
Nov 14 03:31:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:02 devstack sudo[94587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a
Nov 14 03:31:02 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:03 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-bcb1186a-3f23-4010-a9d6-06f4cb206318 tempest-SnapshotsActionsTest-1843356364 None] Create snapshot completed successfully
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-90e2ef0f-b80c-4533-b980-0352a97b632a-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-90e2ef0f-b80c-4533-b980-0352a97b632a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:04 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-quobyte-90e2ef0f-b80c-4533-b980-0352a97b632a" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-90e2ef0f-b80c-4533-b980-0352a97b632a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Deleting offline snapshot 90e2ef0f-b80c-4533-b980-0352a97b632a of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] snapshot_file for this snap is: volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc8673a-9451-40cf-9263-b6b475bf21b4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:04 devstack sudo[94592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a
Nov 14 03:31:04 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:04 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a" returned: 0 in 0.548s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d0674d-df0d-4d8a-be10-616c7c25ea9c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:04 devstack sudo[94597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:04 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:05 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.573s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:05 devstack sudo[94602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a
Nov 14 03:31:05 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:06 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a" returned: 0 in 0.600s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:06 devstack sudo[94608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a
Nov 14 03:31:06 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-32e4efa4-7e47-440a-81b4-3d114e835913 req-c266e41e-77fe-41c4-9f56-9c6af832f7b5 tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-32e4efa4-7e47-440a-81b4-3d114e835913 req-c266e41e-77fe-41c4-9f56-9c6af832f7b5 tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d58fc30-c74f-4df2-8fa7-59f075c030f2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-32e4efa4-7e47-440a-81b4-3d114e835913 req-c266e41e-77fe-41c4-9f56-9c6af832f7b5 tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:06 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034
Nov 14 03:31:06 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:06 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.90e2ef0f-b80c-4533-b980-0352a97b632a" returned: 0 in 0.549s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-90e2ef0f-b80c-4533-b980-0352a97b632a" released by "_delete_snapshot" :: held 2.366s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" released by "delete_snapshot" :: held 2.379s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Created reservations ['92185632-d41e-45a7-aa1a-6c8e03fe4bb5', 'ef8f7cd0-b30e-4fab-8dee-17a9dc1d0e2b', 'ee05f561-4c5f-445f-85ed-3b875f78b01a', '6257eb0a-2a80-4b0c-9931-7ee904c42eee'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:31:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Delete snapshot completed successfully.
Nov 14 03:31:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2106c2bf-e5f0-45f3-b4fd-f3c5e2e163a5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-90e2ef0f-b80c-4533-b980-0352a97b632a-delete_snapshot" released by "delete_snapshot" :: held 2.548s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:07 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-32e4efa4-7e47-440a-81b4-3d114e835913 req-c266e41e-77fe-41c4-9f56-9c6af832f7b5 tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034" returned: 0 in 0.760s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-32e4efa4-7e47-440a-81b4-3d114e835913 req-c266e41e-77fe-41c4-9f56-9c6af832f7b5 tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-32e4efa4-7e47-440a-81b4-3d114e835913 req-c266e41e-77fe-41c4-9f56-9c6af832f7b5 tempest-ServerRescueNegativeTestJSON-437985182 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff701ae1-f6e8-4f1f-a9e8-9210f5b78179', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:31:07 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-32e4efa4-7e47-440a-81b4-3d114e835913 req-c266e41e-77fe-41c4-9f56-9c6af832f7b5 tempest-ServerRescueNegativeTestJSON-437985182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:07 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-32e4efa4-7e47-440a-81b4-3d114e835913 req-c266e41e-77fe-41c4-9f56-9c6af832f7b5 tempest-ServerRescueNegativeTestJSON-437985182 None] attachment_update completed successfully.
Nov 14 03:31:07 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Creating offline snapshot bf30781d-a137-45e2-b0d0-5f6a31d3b068 of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:31:07 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85ff0fb-aca8-4b2e-b36f-77bf4cd5c864]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:07 devstack sudo[94718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:07 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:08 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.643s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:08 devstack sudo[95054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 1G
Nov 14 03:31:08 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:08 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 1G" returned: 0 in 0.611s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:08 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068
Nov 14 03:31:08 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:09 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068" returned: 0 in 0.515s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:09 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 is being set with open permissions: ugo+rw
Nov 14 03:31:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:09 devstack sudo[95064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068
Nov 14 03:31:09 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:09 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068" returned: 0 in 0.444s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:09 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2f0ac7fb-d7a7-4ede-890b-defbc236c469 tempest-SnapshotsActionsTest-1843356364 None] Create snapshot completed successfully
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-bf30781d-a137-45e2-b0d0-5f6a31d3b068-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-bf30781d-a137-45e2-b0d0-5f6a31d3b068-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:10 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-quobyte-bf30781d-a137-45e2-b0d0-5f6a31d3b068" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-bf30781d-a137-45e2-b0d0-5f6a31d3b068" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Deleting offline snapshot bf30781d-a137-45e2-b0d0-5f6a31d3b068 of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] snapshot_file for this snap is: volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c96c278-7310-40af-b2c6-cfedbc543591]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:11 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068
Nov 14 03:31:11 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:11 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068" returned: 0 in 0.606s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d02a96-830d-45eb-b8ec-bf2f1fe10f46]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:11 devstack sudo[95076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:11 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:12 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.692s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:12 devstack sudo[95110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068
Nov 14 03:31:12 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:13 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068" returned: 0 in 0.866s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:13 devstack sudo[95144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068
Nov 14 03:31:13 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:13 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.bf30781d-a137-45e2-b0d0-5f6a31d3b068" returned: 0 in 0.536s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-bf30781d-a137-45e2-b0d0-5f6a31d3b068" released by "_delete_snapshot" :: held 2.786s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" released by "delete_snapshot" :: held 2.802s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=96,cinder:INSERT=27,cinder:UPDATE=130,cinder:DELETE=7 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:INSERT=35,cinder:UPDATE=111,cinder:SELECT=101,cinder:DELETE=15 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Created reservations ['79cdf779-0eab-48f1-9b77-93a74556cfa6', 'd264f665-bd00-464a-8795-8a9268f614a6', '1e674a63-e422-453c-9c03-702f7d264388', '8062ab94-99f7-4af2-9908-59273249a2dd'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:31:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Delete snapshot completed successfully.
Nov 14 03:31:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8216762e-85cc-4c78-b6ba-c8aff45e3f99 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-bf30781d-a137-45e2-b0d0-5f6a31d3b068-delete_snapshot" released by "delete_snapshot" :: held 2.962s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Creating offline snapshot 7cc49598-0d3d-42a9-b27f-b96c04f4849e of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:31:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13250b-002e-4a71-ae9b-e832c60f66a2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:14 devstack sudo[95148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:14 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:14 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.614s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:14 devstack sudo[95153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e 1G
Nov 14 03:31:14 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:15 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e 1G" returned: 0 in 0.827s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:15 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e
Nov 14 03:31:15 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:16 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e" returned: 0 in 0.539s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:16 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e is being set with open permissions: ugo+rw
Nov 14 03:31:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:16 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e
Nov 14 03:31:16 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:16 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e" returned: 0 in 0.477s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3b62d397-5473-432f-ba9f-fb92aaa3ee0e tempest-SnapshotsActionsTest-1843356364 None] Create snapshot completed successfully
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-7cc49598-0d3d-42a9-b27f-b96c04f4849e-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-7cc49598-0d3d-42a9-b27f-b96c04f4849e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:17 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Acquiring lock "cinder-quobyte-7cc49598-0d3d-42a9-b27f-b96c04f4849e" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-7cc49598-0d3d-42a9-b27f-b96c04f4849e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Deleting offline snapshot 7cc49598-0d3d-42a9-b27f-b96c04f4849e of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] snapshot_file for this snap is: volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde84737-ac36-4064-89fa-0b70e7bcac6c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:17 devstack sudo[95256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e
Nov 14 03:31:17 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:18 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e" returned: 0 in 0.592s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2915277f-678c-4164-a4dc-a76558f86eb3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:18 devstack sudo[95261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:18 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:18 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.587s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:18 devstack sudo[95266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e
Nov 14 03:31:18 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:19 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e" returned: 0 in 0.507s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:19 devstack sudo[95271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e
Nov 14 03:31:19 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:19 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.7cc49598-0d3d-42a9-b27f-b96c04f4849e" returned: 0 in 0.466s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-7cc49598-0d3d-42a9-b27f-b96c04f4849e" released by "_delete_snapshot" :: held 2.212s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" released by "delete_snapshot" :: held 2.223s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:19 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Created reservations ['e1ab08d6-17a7-497d-9f21-f2882416bbba', '3962626f-38ff-4c6e-9200-4da3b8f87d61', '253c8106-68a2-4450-80f7-b1027b373118', 'ab508ef4-3fb5-4f56-8855-ff03a664fcad'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:31:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Delete snapshot completed successfully.
Nov 14 03:31:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e2d0c560-4c76-4432-ae8e-20d9f77acfa5 tempest-SnapshotsActionsTest-630451895 None] Lock "cinder-7cc49598-0d3d-42a9-b27f-b96c04f4849e-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "cinder-24d49390-be79-4874-9cb7-ef31df7466b0-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-24d49390-be79-4874-9cb7-ef31df7466b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "cinder-quobyte-24d49390-be79-4874-9cb7-ef31df7466b0" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-quobyte-24d49390-be79-4874-9cb7-ef31df7466b0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Deleting offline snapshot 24d49390-be79-4874-9cb7-ef31df7466b0 of volume 625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:31:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] snapshot_file for this snap is: volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:31:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deca76a-f24b-4dca-9be8-410844472595]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:21 devstack sudo[95310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:21 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:21 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.658s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625a9390-bf9e-4f16-a319-b5f580261077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:31:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9690913f-169d-4f6a-9a95-6274907ba3b9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:21 devstack sudo[95360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077
Nov 14 03:31:21 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:22 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077" returned: 0 in 0.682s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:22 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:22 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:23 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.629s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:23 devstack sudo[95372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0
Nov 14 03:31:23 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:23 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077.24d49390-be79-4874-9cb7-ef31df7466b0" returned: 0 in 0.510s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-quobyte-24d49390-be79-4874-9cb7-ef31df7466b0" released by "_delete_snapshot" :: held 2.568s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" released by "delete_snapshot" :: held 2.589s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:23 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Created reservations ['40e8c440-2ee4-436d-a090-7cc77b2b985c', '73cdb834-9195-41a3-be8c-0020bd3882e9', '83d8c562-58b7-4fa6-b262-ecd7dde58f1e', 'b56dee98-a8a0-4cc6-927b-a02f2d0de542'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:31:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Delete snapshot completed successfully.
Nov 14 03:31:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5124dbe-574d-424f-9b08-80b512fbe022 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-24d49390-be79-4874-9cb7-ef31df7466b0-delete_snapshot" released by "delete_snapshot" :: held 2.723s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "cinder-625a9390-bf9e-4f16-a319-b5f580261077-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-625a9390-bf9e-4f16-a319-b5f580261077-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:24 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e1e4e9-8ebd-4618-842c-105020424ff7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:24 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077
Nov 14 03:31:24 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:25 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077" returned: 0 in 0.902s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:25 devstack sudo[95447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077
Nov 14 03:31:25 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:25 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-625a9390-bf9e-4f16-a319-b5f580261077" returned: 0 in 0.617s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-quobyte-625a9390-bf9e-4f16-a319-b5f580261077" released by "delete_volume" :: held 1.577s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Created reservations ['a7b71639-072c-49a0-8d8c-b5b0dddcbaeb', '35301fdf-4c0b-4738-80be-ca5a30aafb38', 'ad0fef11-ce5b-4abe-adab-fe8ab30eb60d', '77a0e061-92bd-4c85-a755-556ab36f5e5d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:25 devstack sudo[95457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:31:25 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Acquiring lock "cinder-338bc6d3-03ff-445f-9a38-d869f4bd00ad-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Lock "cinder-338bc6d3-03ff-445f-9a38-d869f4bd00ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Acquiring lock "cinder-quobyte-338bc6d3-03ff-445f-9a38-d869f4bd00ad" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Lock "cinder-quobyte-338bc6d3-03ff-445f-9a38-d869f4bd00ad" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b758a747-1b62-4731-9bb0-58be49e88c18]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:26 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.703s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:31:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Deleted volume successfully.
Nov 14 03:31:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-613a63a1-080c-4a1a-b360-423023591418 tempest-SnapshotsActionsTest-1843356364 None] Lock "cinder-625a9390-bf9e-4f16-a319-b5f580261077-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:26 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad
Nov 14 03:31:26 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:27 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad" returned: 0 in 0.759s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:27 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad
Nov 14 03:31:27 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:27 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-338bc6d3-03ff-445f-9a38-d869f4bd00ad" returned: 0 in 0.595s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Lock "cinder-quobyte-338bc6d3-03ff-445f-9a38-d869f4bd00ad" released by "delete_volume" :: held 1.398s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Created reservations ['20e07f3b-a669-4358-be31-9b64429c45d8', 'dad6de22-e3d0-4ae5-9e37-d6366ca01ed2', '9cf2e13a-5836-4d46-8357-aaa825dcd2e7', 'd94a1186-7576-4d6d-b079-177ef03bd96c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:27 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:31:27 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:28 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.553s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:28 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:31:28 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Deleted volume successfully.
Nov 14 03:31:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-941e48a1-2c68-4ba3-a5ca-7df7040af7ae tempest-VolumesNegativeTest-342890874 None] Lock "cinder-338bc6d3-03ff-445f-9a38-d869f4bd00ad-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:37 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=37,cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=10 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:31:38 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=22,cinder:INSERT=10,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:31:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Flow 'volume_create_manager' (41189584-627b-4b63-b032-20098a79394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e71a593-aeb9-4f02-8046-e7d7de1a62fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e71a593-aeb9-4f02-8046-e7d7de1a62fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1883675386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99c99bb-5613-418e-8b8e-d32b5181b659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b71e3ebd3dc4b68bf6c0ee20ce9185a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:31:45Z,use_quota=True,user_id='c08a28cef42f4b14887e6478982f1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61572a70-cd4c-4b03-aea7-ee87f78c6424),volume_type_id=61572a70-cd4c-4b03-aea7-ee87f78c6424)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1512e24-b0af-46df-8798-8da73cef9190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1512e24-b0af-46df-8798-8da73cef9190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659da7f5-6997-4f08-a1e2-b1a872d599ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659da7f5-6997-4f08-a1e2-b1a872d599ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99c99bb-5613-418e-8b8e-d32b5181b659', 'volume_name': 'volume-e99c99bb-5613-418e-8b8e-d32b5181b659', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2a185b-4748-464f-a81d-1e6ec210873d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2a185b-4748-464f-a81d-1e6ec210873d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20072b1-f42e-4ae3-8f45-026a371d8fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:45 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Volume e99c99bb-5613-418e-8b8e-d32b5181b659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99c99bb-5613-418e-8b8e-d32b5181b659', 'volume_size': 1}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1883675386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99c99bb-5613-418e-8b8e-d32b5181b659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b71e3ebd3dc4b68bf6c0ee20ce9185a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:31:45Z,use_quota=True,user_id='c08a28cef42f4b14887e6478982f1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61572a70-cd4c-4b03-aea7-ee87f78c6424),volume_type_id=61572a70-cd4c-4b03-aea7-ee87f78c6424)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Creating volume e99c99bb-5613-418e-8b8e-d32b5181b659 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:31:45 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:45 devstack sudo[95505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659 1073741824
Nov 14 03:31:45 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:45 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659 1073741824" returned: 0 in 0.762s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:45 devstack sudo[95510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659
Nov 14 03:31:45 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:46 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659" returned: 0 in 0.563s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:31:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20072b1-f42e-4ae3-8f45-026a371d8fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99c99bb-5613-418e-8b8e-d32b5181b659', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7e7767-7f47-4492-a09e-0255f743062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:46 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Volume volume-e99c99bb-5613-418e-8b8e-d32b5181b659 (e99c99bb-5613-418e-8b8e-d32b5181b659): created successfully
Nov 14 03:31:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7e7767-7f47-4492-a09e-0255f743062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Flow 'volume_create_manager' (41189584-627b-4b63-b032-20098a79394c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:31:46 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-df3795a3-3fd6-4005-8f4a-7c83d590e012 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Created volume successfully.
Nov 14 03:31:47 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:31:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:31:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:47 devstack sudo[95519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:31:47 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:47 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.543s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:47 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:31:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9545c298-4519-4f76-8b6e-8a0509f10a09 tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Retype volume completed successfully.
Nov 14 03:31:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Acquiring lock "cinder-e99c99bb-5613-418e-8b8e-d32b5181b659-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "cinder-e99c99bb-5613-418e-8b8e-d32b5181b659-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Acquiring lock "cinder-quobyte-e99c99bb-5613-418e-8b8e-d32b5181b659" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:31:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "cinder-quobyte-e99c99bb-5613-418e-8b8e-d32b5181b659" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:31:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7645f2b-8bd1-4a60-a68c-a2dd0865eb9e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:48 devstack sudo[95524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659
Nov 14 03:31:48 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:49 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659" returned: 0 in 0.660s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:49 devstack sudo[95529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659
Nov 14 03:31:49 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:49 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Flow 'volume_create_manager' (71293f3d-e675-489d-a137-f578d3d7f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b31e64c-0965-4bda-9701-f6138ca7916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b31e64c-0965-4bda-9701-f6138ca7916c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2095543063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db64091-645a-4d15-8105-e0e8b957436f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde3670e22741fbb4f371f17beee9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:31:50Z,use_quota=True,user_id='ba4ff212b00d43a193c5daddb81b327f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bd8901-cf3f-4a73-aa37-441de9b78f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bd8901-cf3f-4a73-aa37-441de9b78f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddd8331-aec0-4044-9ddc-6b07329e77d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:49 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e99c99bb-5613-418e-8b8e-d32b5181b659" returned: 0 in 0.519s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "cinder-quobyte-e99c99bb-5613-418e-8b8e-d32b5181b659" released by "delete_volume" :: held 1.214s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:49 devstack cinder-volume[80846]: WARNING cinder.quota [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:31:49 devstack cinder-volume[80846]: WARNING cinder.quota [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Created reservations ['0ad9799b-fa9b-47c9-bfb2-6645a74ef149', '7c31ca8e-8fd2-4b9d-bebd-fa3f1e906728', '2f3c4811-5abd-4dbb-9971-b523a4427f53', '7a9b4c4d-144b-449c-bdf4-7febb0850505'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddd8331-aec0-4044-9ddc-6b07329e77d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4db64091-645a-4d15-8105-e0e8b957436f', 'volume_name': 'volume-4db64091-645a-4d15-8105-e0e8b957436f', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26d8b6d0>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae456d34-5102-48b9-ba59-56fd38c033f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae456d34-5102-48b9-ba59-56fd38c033f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0573afb-182a-4e4a-9e5b-02e04585922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:49 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Volume 4db64091-645a-4d15-8105-e0e8b957436f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4db64091-645a-4d15-8105-e0e8b957436f', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26d8b6d0>}
Nov 14 03:31:49 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Cloning 4db64091-645a-4d15-8105-e0e8b957436f from image 505e4538-4930-46f5-ae28-a520ed743bcf  at location (None, None). {{(pid=80846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:50 devstack sudo[95532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:31:50 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:31:50 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Image download 20.69 MB at 20.69 MB/s
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8b6fd2-1227-4e83-8a8f-015ff8c38ad7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:50 devstack sudo[95534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD
Nov 14 03:31:50 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:50 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.489s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:31:50 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Deleted volume successfully.
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f9c4d35f-f7d1-46aa-bce9-fd6244fb3e2d tempest-VolumeRetypeWithoutMigrationTest-1127968164 None] Lock "cinder-e99c99bb-5613-418e-8b8e-d32b5181b659-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:31:50 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD" returned: 0 in 0.539s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf is fetched for user ba4ff212b00d43a193c5daddb81b327f. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0976eaa5-df97-462a-9ad0-dbd6dafa5729]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:50 devstack sudo[95541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD
Nov 14 03:31:50 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:51 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2095543063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db64091-645a-4d15-8105-e0e8b957436f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde3670e22741fbb4f371f17beee9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:31:50Z,use_quota=True,user_id='ba4ff212b00d43a193c5daddb81b327f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Creating volume 4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:31:51 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:31:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:51 devstack sudo[95546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f 1073741824
Nov 14 03:31:51 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:52 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f 1073741824" returned: 0 in 0.642s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:52 devstack sudo[95551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:31:52 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:52 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 0 in 0.521s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:31:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:52 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Attempting download of 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 4db64091-645a-4d15-8105-e0e8b957436f. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:31:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc24b3f9-f717-43d8-9859-7620b110b38e]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_h9kv5yd6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:52 devstack sudo[95554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_h9kv5yd6
Nov 14 03:31:52 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:53 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_h9kv5yd6" returned: 0 in 0.569s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_h9kv5yd6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:53 devstack sudo[95558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_h9kv5yd6
Nov 14 03:31:53 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:53 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_h9kv5yd6" returned: 1 in 0.742s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_h9kv5yd6' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:31:53 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[935ad6cc-7d49-499e-9288-4b369a862fcd]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:54 devstack sudo[95562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD
Nov 14 03:31:54 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:54 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:31:54 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:54 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD" returned: 0 in 0.679s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] 505e4538-4930-46f5-ae28-a520ed743bcf was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:54 devstack sudo[95570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:31:54 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:54 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.515s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:31:55 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 0 in 1.002s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:55 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_gwj6h9qmdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:31:55 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Converted 112.00 MB image at 111.66 MB/s
Nov 14 03:31:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:55 devstack sudo[95586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f 1G
Nov 14 03:31:55 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:56 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f 1G" returned: 0 in 0.516s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:56 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[855de735-9b69-43fb-b744-439368931473]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:31:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:56 devstack sudo[95591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:31:56 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:56 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 0 in 0.586s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:56 devstack sudo[95600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:31:56 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:57 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 1 in 0.572s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Downloaded image 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume 4db64091-645a-4d15-8105-e0e8b957436f successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf for user ba4ff212b00d43a193c5daddb81b327f is deleted. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Marking volume 4db64091-645a-4d15-8105-e0e8b957436f as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Copying metadata from image 505e4538-4930-46f5-ae28-a520ed743bcf to 4db64091-645a-4d15-8105-e0e8b957436f. {{(pid=80846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Creating volume glance metadata for volume 4db64091-645a-4d15-8105-e0e8b957436f backed by image 505e4538-4930-46f5-ae28-a520ed743bcf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0573afb-182a-4e4a-9e5b-02e04585922c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db64091-645a-4d15-8105-e0e8b957436f', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26d8b6d0>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7627e510-48ec-4ce3-afcb-e44a5c957530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:57 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Volume volume-4db64091-645a-4d15-8105-e0e8b957436f (4db64091-645a-4d15-8105-e0e8b957436f): created successfully
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7627e510-48ec-4ce3-afcb-e44a5c957530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Flow 'volume_create_manager' (71293f3d-e675-489d-a137-f578d3d7f55f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:31:57 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-88303a2b-b53c-428d-8c05-883557357a2b tempest-TestShelveInstance-1469316758 None] Created volume successfully.
Nov 14 03:31:58 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Flow 'volume_create_manager' (638d5640-511e-488e-8c3f-135ba422c7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71079e2e-ca15-402e-a48d-0b9e250b5623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71079e2e-ca15-402e-a48d-0b9e250b5623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1281741357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9233f889-ea92-41c4-95b0-533cb940031f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5882fd4a7b79455ab51c9222768a9f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:31:58Z,use_quota=True,user_id='2adc5e79be524b96ad8deabfa379feb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed30d7fb-2b61-44a6-82aa-1ae37d774a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed30d7fb-2b61-44a6-82aa-1ae37d774a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6099b9-b127-4d37-897d-e6e829bb7d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6099b9-b127-4d37-897d-e6e829bb7d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9233f889-ea92-41c4-95b0-533cb940031f', 'volume_name': 'volume-9233f889-ea92-41c4-95b0-533cb940031f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec52c85a-ce96-4a19-80e5-88b298e38a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec52c85a-ce96-4a19-80e5-88b298e38a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946c9e9c-241a-4b0c-956b-64cb7504a322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:58 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Volume 9233f889-ea92-41c4-95b0-533cb940031f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9233f889-ea92-41c4-95b0-533cb940031f', 'volume_size': 1}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1281741357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9233f889-ea92-41c4-95b0-533cb940031f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5882fd4a7b79455ab51c9222768a9f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:31:58Z,use_quota=True,user_id='2adc5e79be524b96ad8deabfa379feb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Creating volume 9233f889-ea92-41c4-95b0-533cb940031f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:31:58 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:31:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:58 devstack sudo[95605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f 1073741824
Nov 14 03:31:58 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:59 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f 1073741824" returned: 0 in 0.597s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:31:59 devstack sudo[95612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f
Nov 14 03:31:59 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:31:59 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f" returned: 0 in 0.450s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946c9e9c-241a-4b0c-956b-64cb7504a322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9233f889-ea92-41c4-95b0-533cb940031f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76fdb48-b97d-4a97-a873-ac4e03a76759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:31:59 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Volume volume-9233f889-ea92-41c4-95b0-533cb940031f (9233f889-ea92-41c4-95b0-533cb940031f): created successfully
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76fdb48-b97d-4a97-a873-ac4e03a76759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:31:59 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Flow 'volume_create_manager' (638d5640-511e-488e-8c3f-135ba422c7f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:31:59 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-19ac2ded-f8a2-4596-b818-6d3bf052c616 tempest-SnapshotMetadataTestJSON-860823769 None] Created volume successfully.
Nov 14 03:32:00 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Creating offline snapshot 40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 of volume 9233f889-ea92-41c4-95b0-533cb940031f {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:32:00 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0adb68-d7ed-45d4-a7d1-87332fbbbccd]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:32:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:00 devstack sudo[95616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f
Nov 14 03:32:00 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:01 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f" returned: 0 in 0.587s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:01 devstack sudo[95621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 1G
Nov 14 03:32:01 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:01 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 1G" returned: 0 in 0.550s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9233f889-ea92-41c4-95b0-533cb940031f -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:01 devstack sudo[95626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9233f889-ea92-41c4-95b0-533cb940031f -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6
Nov 14 03:32:01 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:02 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9233f889-ea92-41c4-95b0-533cb940031f -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6" returned: 0 in 0.516s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:02 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 is being set with open permissions: ugo+rw
Nov 14 03:32:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:02 devstack sudo[95632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6
Nov 14 03:32:02 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:02 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6" returned: 0 in 0.516s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:02 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.info
Nov 14 03:32:02 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:03 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.info" returned: 0 in 0.564s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:03 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.info is being set with open permissions: ugo+rw
Nov 14 03:32:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:03 devstack sudo[95642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.info
Nov 14 03:32:03 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:04 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.info" returned: 0 in 0.580s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.378s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a2d91794-873f-4c10-91b9-b69932ca4f2d tempest-SnapshotMetadataTestJSON-860823769 None] Create snapshot completed successfully
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5319cd5-ad4e-4c51-baf1-e338e33923a8]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:05 devstack sudo[95661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:32:05 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "cinder-40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:05 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "cinder-quobyte-9233f889-ea92-41c4-95b0-533cb940031f" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-quobyte-9233f889-ea92-41c4-95b0-533cb940031f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "cinder-quobyte-40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-quobyte-40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Deleting offline snapshot 40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 of volume 9233f889-ea92-41c4-95b0-533cb940031f {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] snapshot_file for this snap is: volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4c0283-2ca7-4b1d-8603-069e4d0ff40b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:05 devstack sudo[95665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6
Nov 14 03:32:05 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:05 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 0 in 0.674s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:05 devstack sudo[95670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:32:05 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:06 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6" returned: 0 in 0.620s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9233f889-ea92-41c4-95b0-533cb940031f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4425ba-11d5-4beb-b04f-d21f47e0d05c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:06 devstack sudo[95677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f
Nov 14 03:32:06 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:06 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 1 in 0.582s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.304s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-4db64091-645a-4d15-8105-e0e8b957436f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1eef573-ba42-4219-b625-74a45e6b3ab4', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:32:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-975952d7-f6aa-4d65-b5bb-d6d1e855c8c9 req-b82fe25d-1caa-472c-9e21-b2af81e97eaa tempest-TestShelveInstance-1469316758 None] attachment_update completed successfully.
Nov 14 03:32:06 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f" returned: 0 in 0.616s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:06 devstack sudo[95685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6
Nov 14 03:32:06 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:07 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6" returned: 0 in 0.548s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:07 devstack sudo[95700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6
Nov 14 03:32:07 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:07 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f.40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6" returned: 0 in 0.481s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-quobyte-40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6" released by "_delete_snapshot" :: held 2.343s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-quobyte-9233f889-ea92-41c4-95b0-533cb940031f" released by "delete_snapshot" :: held 2.358s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:07 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Created reservations ['ed5243fc-cdbd-450c-952f-e1f895ef84e9', '0afb86df-4c21-48ba-a8ad-8c644321531a', '38042fe5-57bb-4c9d-be10-01c9db7c4dc3', '35ec903d-602c-46d4-bae6-a438c9cb06db'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:32:07 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Delete snapshot completed successfully.
Nov 14 03:32:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71eaef73-fcbc-48ba-b57d-e2638ee465d0 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-40a7a9ba-7fbe-4f20-bf34-e77e2b18a6d6-delete_snapshot" released by "delete_snapshot" :: held 2.447s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "cinder-9233f889-ea92-41c4-95b0-533cb940031f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-9233f889-ea92-41c4-95b0-533cb940031f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:08 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "cinder-quobyte-9233f889-ea92-41c4-95b0-533cb940031f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-quobyte-9233f889-ea92-41c4-95b0-533cb940031f" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:08 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[14edb782-db65-4386-b7d5-45dcc075da9f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:32:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:08 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f
Nov 14 03:32:08 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:09 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f" returned: 0 in 0.613s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:09 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f
Nov 14 03:32:09 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:09 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9233f889-ea92-41c4-95b0-533cb940031f" returned: 0 in 0.472s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-quobyte-9233f889-ea92-41c4-95b0-533cb940031f" released by "delete_volume" :: held 1.140s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Created reservations ['14514074-a588-4207-9af6-813969e42b8d', '8a38e3dd-f911-45c5-b9cb-8057143a0f00', '5578aa68-f13c-425f-a1fc-53a1238b49f8', '3ff37b2f-4b4f-44d8-9731-831cf17afc38'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:09 devstack sudo[95729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:32:09 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:10 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.438s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:10 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:32:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Deleted volume successfully.
Nov 14 03:32:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-099ca15f-0ac3-47d2-abea-b036ee824863 tempest-SnapshotMetadataTestJSON-860823769 None] Lock "cinder-9233f889-ea92-41c4-95b0-533cb940031f-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Flow 'volume_create_manager' (a28d9ac9-48b0-4986-9a9c-6ae436f99b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa4460f-cf88-457a-8638-5b4f5e1824b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa4460f-cf88-457a-8638-5b4f5e1824b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1808533747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32a976e-0a49-4f89-bf7d-99ff2798477d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db12212cc9c043b2a0d988c63ad9db80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:32:14Z,use_quota=True,user_id='86675803524848d385b9190af1f8483d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b1dfcc-773a-4604-8689-ef111497c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b1dfcc-773a-4604-8689-ef111497c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08efdae7-ff7d-49de-be15-9184c2df59b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08efdae7-ff7d-49de-be15-9184c2df59b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32a976e-0a49-4f89-bf7d-99ff2798477d', 'volume_name': 'volume-f32a976e-0a49-4f89-bf7d-99ff2798477d', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a32d9bd-c169-4e50-8a8f-eebe6bda6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a32d9bd-c169-4e50-8a8f-eebe6bda6683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da44a7e9-32f0-451d-8f3c-493ce1679a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Volume f32a976e-0a49-4f89-bf7d-99ff2798477d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32a976e-0a49-4f89-bf7d-99ff2798477d', 'volume_size': 1}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1808533747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32a976e-0a49-4f89-bf7d-99ff2798477d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db12212cc9c043b2a0d988c63ad9db80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:32:14Z,use_quota=True,user_id='86675803524848d385b9190af1f8483d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Creating volume f32a976e-0a49-4f89-bf7d-99ff2798477d {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:32:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:32:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:32:14 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:32:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:14 devstack sudo[95790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d 1073741824
Nov 14 03:32:14 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:14 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d 1073741824" returned: 0 in 0.649s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:14 devstack sudo[95795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d
Nov 14 03:32:14 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:15 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d" returned: 0 in 0.528s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:32:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da44a7e9-32f0-451d-8f3c-493ce1679a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32a976e-0a49-4f89-bf7d-99ff2798477d', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ce7122-322b-40a0-b775-c2d5f1bfc15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:15 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Volume volume-f32a976e-0a49-4f89-bf7d-99ff2798477d (f32a976e-0a49-4f89-bf7d-99ff2798477d): created successfully
Nov 14 03:32:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ce7122-322b-40a0-b775-c2d5f1bfc15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Flow 'volume_create_manager' (a28d9ac9-48b0-4986-9a9c-6ae436f99b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:32:15 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-fc8de52e-aa95-4f88-b149-df9a4d48ae4a tempest-AbsoluteLimitsTests-563869171 None] Created volume successfully.
Nov 14 03:32:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Acquiring lock "cinder-f32a976e-0a49-4f89-bf7d-99ff2798477d-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Lock "cinder-f32a976e-0a49-4f89-bf7d-99ff2798477d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:16 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Acquiring lock "cinder-quobyte-f32a976e-0a49-4f89-bf7d-99ff2798477d" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Lock "cinder-quobyte-f32a976e-0a49-4f89-bf7d-99ff2798477d" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:16 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f6aa63-c0fe-4b34-92b1-f24f3df32353]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:32:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:16 devstack sudo[95801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d
Nov 14 03:32:16 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:16 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d" returned: 0 in 0.555s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:16 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d
Nov 14 03:32:16 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:17 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f32a976e-0a49-4f89-bf7d-99ff2798477d" returned: 0 in 0.440s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Lock "cinder-quobyte-f32a976e-0a49-4f89-bf7d-99ff2798477d" released by "delete_volume" :: held 1.046s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Created reservations ['eac90e25-f7ab-410a-acbc-963ada4c447f', '0cd71c98-7e54-4487-b3ad-942f6309ae33', '00f3ff02-9f2b-49e9-9df1-ff35e18a1ac2', '74745ea5-76bd-4b1a-bace-9d54501a8303'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:17 devstack sudo[95809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:32:17 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:17 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.448s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:32:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Deleted volume successfully.
Nov 14 03:32:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1bcf2f57-ef2b-46de-9cc6-f3e3bee8aadc tempest-AbsoluteLimitsTests-563869171 None] Lock "cinder-f32a976e-0a49-4f89-bf7d-99ff2798477d-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=49,cinder:UPDATE=54,cinder:DELETE=6,cinder:INSERT=23 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:32:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Flow 'volume_create_manager' (9b317a90-7e66-4502-956d-d15ac1a0841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04059676-f1b1-4e18-a619-6b00e372e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04059676-f1b1-4e18-a619-6b00e372e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-648294833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1643028-43ff-4b92-92af-673fdf05f04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f8f751d834355b998ec2743a9b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:32:28Z,use_quota=True,user_id='19c6fd296ecc498eb087c5d5a861bf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f53eeb2-d6a9-445f-aa14-3b5d5db7ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f53eeb2-d6a9-445f-aa14-3b5d5db7ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28dc30d4-2ae8-44c6-a267-58f9730c0e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28dc30d4-2ae8-44c6-a267-58f9730c0e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1643028-43ff-4b92-92af-673fdf05f04c', 'volume_name': 'volume-e1643028-43ff-4b92-92af-673fdf05f04c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18802605-2e4b-49bb-82ad-0dcca653f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18802605-2e4b-49bb-82ad-0dcca653f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c376c9a-0653-43ab-88e4-c8f55748eb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:27 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Volume e1643028-43ff-4b92-92af-673fdf05f04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1643028-43ff-4b92-92af-673fdf05f04c', 'volume_size': 1}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-648294833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1643028-43ff-4b92-92af-673fdf05f04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f8f751d834355b998ec2743a9b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:32:28Z,use_quota=True,user_id='19c6fd296ecc498eb087c5d5a861bf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Creating volume e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:32:27 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:32:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:27 devstack sudo[95854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c 1073741824
Nov 14 03:32:27 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:28 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c 1073741824" returned: 0 in 0.527s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:28 devstack sudo[95859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:32:28 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:28 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.430s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c376c9a-0653-43ab-88e4-c8f55748eb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1643028-43ff-4b92-92af-673fdf05f04c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d618d1f-bbf0-4ebb-a547-7d13ea0bd663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:32:28 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Volume volume-e1643028-43ff-4b92-92af-673fdf05f04c (e1643028-43ff-4b92-92af-673fdf05f04c): created successfully
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d618d1f-bbf0-4ebb-a547-7d13ea0bd663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:32:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Flow 'volume_create_manager' (9b317a90-7e66-4502-956d-d15ac1a0841f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:32:28 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-43d29750-cabe-4e0c-81d3-c04c9a17d89c tempest-VolumesActionsTest-1559513615 None] Created volume successfully.
Nov 14 03:32:32 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-99a3ef6c-27c0-4c53-bb43-71a79aa26cde req-0753d9a4-d417-4f9e-a696-7490d3520ade tempest-ServerRescueNegativeTestJSON-437985182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:32 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-99a3ef6c-27c0-4c53-bb43-71a79aa26cde req-0753d9a4-d417-4f9e-a696-7490d3520ade tempest-ServerRescueNegativeTestJSON-437985182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:32 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-99a3ef6c-27c0-4c53-bb43-71a79aa26cde req-0753d9a4-d417-4f9e-a696-7490d3520ade tempest-ServerRescueNegativeTestJSON-437985182 None] Terminate volume connection completed successfully.
Nov 14 03:32:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-99a3ef6c-27c0-4c53-bb43-71a79aa26cde req-0753d9a4-d417-4f9e-a696-7490d3520ade tempest-ServerRescueNegativeTestJSON-437985182 None] Deleting attachment ff701ae1-f6e8-4f1f-a9e8-9210f5b78179. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:32:38 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=42,cinder:SELECT=43,cinder:INSERT=6,cinder:DELETE=3 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:32:42 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:32:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "cinder-3287a6c1-b049-4eac-926c-8a0d8dbd0034-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "cinder-3287a6c1-b049-4eac-926c-8a0d8dbd0034-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "cinder-quobyte-3287a6c1-b049-4eac-926c-8a0d8dbd0034" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "cinder-quobyte-3287a6c1-b049-4eac-926c-8a0d8dbd0034" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:43 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b851e4c-9216-4bec-9423-48b947330997]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:32:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:43 devstack sudo[95993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034
Nov 14 03:32:43 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:43 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034" returned: 0 in 0.595s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:43 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034
Nov 14 03:32:43 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:44 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3287a6c1-b049-4eac-926c-8a0d8dbd0034" returned: 0 in 0.480s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "cinder-quobyte-3287a6c1-b049-4eac-926c-8a0d8dbd0034" released by "delete_volume" :: held 1.136s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Created reservations ['f790b4c3-ad93-44d2-8553-3499ee38b0bd', '0c2495eb-2d71-475a-873a-b1371e0ae388', '5c3aed51-b596-4d08-9451-32a69c543c69', '73e8f9f7-67b6-44a2-8c45-e475d3fe2180'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:44 devstack sudo[96003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:32:44 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a49c4047-52cc-46a0-95c3-793ad276a352 tempest-VolumesActionsTest-1559513615 None] Acquiring lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c" by "attach_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a49c4047-52cc-46a0-95c3-793ad276a352 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c" acquired by "attach_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:44 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a49c4047-52cc-46a0-95c3-793ad276a352 tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a49c4047-52cc-46a0-95c3-793ad276a352 tempest-VolumesActionsTest-1559513615 None] Attaching volume e1643028-43ff-4b92-92af-673fdf05f04c to instance 3f76a741-f586-420a-9623-6da1fd09c5d1 at mountpoint /dev/vdb on host None.
Nov 14 03:32:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a49c4047-52cc-46a0-95c3-793ad276a352 tempest-VolumesActionsTest-1559513615 None] Attach volume completed successfully.
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a49c4047-52cc-46a0-95c3-793ad276a352 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c" released by "attach_volume" :: held 0.078s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:44 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.502s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:32:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Deleted volume successfully.
Nov 14 03:32:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0bca3bba-9648-4ef6-b8a9-b36590e87eef tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "cinder-3287a6c1-b049-4eac-926c-8a0d8dbd0034-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6f8ef5a5-84ad-4dc4-bb7b-f5edfc34346a tempest-VolumesActionsTest-1559513615 None] Acquiring lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-detach_volume" by "detach_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6f8ef5a5-84ad-4dc4-bb7b-f5edfc34346a tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6f8ef5a5-84ad-4dc4-bb7b-f5edfc34346a tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6f8ef5a5-84ad-4dc4-bb7b-f5edfc34346a tempest-VolumesActionsTest-1559513615 None] Detaching volume e1643028-43ff-4b92-92af-673fdf05f04c from instance 3f76a741-f586-420a-9623-6da1fd09c5d1.
Nov 14 03:32:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6f8ef5a5-84ad-4dc4-bb7b-f5edfc34346a tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6f8ef5a5-84ad-4dc4-bb7b-f5edfc34346a tempest-VolumesActionsTest-1559513615 None] Detach volume completed successfully.
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-6f8ef5a5-84ad-4dc4-bb7b-f5edfc34346a tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "cinder-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "cinder-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "cinder-quobyte-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "cinder-quobyte-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e589de3c-4195-4f9e-87e5-abbaef850e2e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:32:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:45 devstack sudo[96006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e
Nov 14 03:32:45 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:46 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e" returned: 0 in 0.703s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:46 devstack sudo[96011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e
Nov 14 03:32:46 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:46 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e" returned: 0 in 0.462s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "cinder-quobyte-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e" released by "delete_volume" :: held 1.219s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Created reservations ['a27b9ded-3836-487e-a772-2ab4476ee990', '8b527808-2ef6-449f-8a8d-4a0966b8ee1c', '969c2908-2031-4640-a8e8-ea8932048da9', '02ce2a03-e16d-49bc-9b13-5b32b0e354eb'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:46 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:32:46 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:47 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.519s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:47 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:32:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Deleted volume successfully.
Nov 14 03:32:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a849f7ce-acf3-442b-a9a1-a444e3ba0f67 tempest-ServerRescueNegativeTestJSON-437985182 None] Lock "cinder-0462ad7b-14f3-474c-8c2e-eafe1ac22e0e-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:32:54 devstack sudo[96095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:32:54 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:32:54 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.532s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:32:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:32:56 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=19 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:32:57 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=19,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=2 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:33:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f7851502-5e56-4cb6-8fda-69af76b713e7 tempest-VolumesActionsTest-1559513615 None] Acquiring lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c" by "attach_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:33:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f7851502-5e56-4cb6-8fda-69af76b713e7 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c" acquired by "attach_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:33:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f7851502-5e56-4cb6-8fda-69af76b713e7 tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f7851502-5e56-4cb6-8fda-69af76b713e7 tempest-VolumesActionsTest-1559513615 None] Attaching volume e1643028-43ff-4b92-92af-673fdf05f04c to instance 4da199a0-f1ec-4717-bada-c000a70053ea at mountpoint /dev/vdb on host None.
Nov 14 03:33:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f7851502-5e56-4cb6-8fda-69af76b713e7 tempest-VolumesActionsTest-1559513615 None] Attach volume completed successfully.
Nov 14 03:33:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f7851502-5e56-4cb6-8fda-69af76b713e7 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c" released by "attach_volume" :: held 0.069s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:33:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8430ef6b-e478-4a0f-91da-4edb2ea52b49 tempest-VolumesActionsTest-1559513615 None] Acquiring lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-detach_volume" by "detach_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:33:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8430ef6b-e478-4a0f-91da-4edb2ea52b49 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:33:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8430ef6b-e478-4a0f-91da-4edb2ea52b49 tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8430ef6b-e478-4a0f-91da-4edb2ea52b49 tempest-VolumesActionsTest-1559513615 None] Detaching volume e1643028-43ff-4b92-92af-673fdf05f04c from instance 4da199a0-f1ec-4717-bada-c000a70053ea.
Nov 14 03:33:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8430ef6b-e478-4a0f-91da-4edb2ea52b49 tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8430ef6b-e478-4a0f-91da-4edb2ea52b49 tempest-VolumesActionsTest-1559513615 None] Detach volume completed successfully.
Nov 14 03:33:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8430ef6b-e478-4a0f-91da-4edb2ea52b49 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:33:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08f97b4-1523-4f89-8e90-088ac878feb4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:14 devstack sudo[96337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:33:14 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:15 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.569s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:15 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6b6d2e-f989-468d-a5f1-e4dbbdc73744]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:15 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:33:15 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:15 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.570s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.c0b19cb5-f2a4-4bbe-82c8-778d009cfcbdykegdrsz.img {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:15 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.c0b19cb5-f2a4-4bbe-82c8-778d009cfcbdykegdrsz.img
Nov 14 03:33:15 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:16 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:33:18 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.c0b19cb5-f2a4-4bbe-82c8-778d009cfcbdykegdrsz.img" returned: 0 in 2.244s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[417d2be1-c13e-42ba-b914-000a86f94125]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:18 devstack sudo[96364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:33:18 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:18 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.752s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:18 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.c0b19cb5-f2a4-4bbe-82c8-778d009cfcbdykegdrsz.img {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:33:18 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Converted 1024.00 MB image at 456.07 MB/s
Nov 14 03:33:18 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] c0b19cb5-f2a4-4bbe-82c8-778d009cfcbd was raw, no need to convert to raw {{(pid=80846) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Nov 14 03:33:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-523f781e-d635-44bb-9069-b70510898198 req-32366214-9c1a-45b9-b16f-f8ea8ff99cd3 tempest-TestShelveInstance-1469316758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-523f781e-d635-44bb-9069-b70510898198 req-32366214-9c1a-45b9-b16f-f8ea8ff99cd3 tempest-TestShelveInstance-1469316758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:24 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-523f781e-d635-44bb-9069-b70510898198 req-32366214-9c1a-45b9-b16f-f8ea8ff99cd3 tempest-TestShelveInstance-1469316758 None] Terminate volume connection completed successfully.
Nov 14 03:33:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-523f781e-d635-44bb-9069-b70510898198 req-32366214-9c1a-45b9-b16f-f8ea8ff99cd3 tempest-TestShelveInstance-1469316758 None] Deleting attachment d1eef573-ba42-4219-b625-74a45e6b3ab4. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:33:28 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:33:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.102s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:30 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Uploaded volume to glance image-id: c0b19cb5-f2a4-4bbe-82c8-778d009cfcbd. {{(pid=80846) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Nov 14 03:33:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.897s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:30 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0669fb9e-a67f-4a2b-85ac-d921bceb6208 tempest-VolumesActionsTest-1559513615 None] Copy volume to image completed successfully.
Nov 14 03:33:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1245163-42d2-41c5-817b-70ee7078ed88]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:31 devstack sudo[96551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:33:31 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:31 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 0 in 0.635s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:31 devstack sudo[96555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:33:31 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:31 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:32 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 1 in 0.634s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.301s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.214s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[12740c6f-fb96-4a4f-97fc-3b18a463dc14]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-4db64091-645a-4d15-8105-e0e8b957436f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22332f5f-24b5-47e2-99b1-211897ec9d3a', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:33:32 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:32 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-9d653a39-8ed3-4d38-88b9-34002dd5ee98 req-87e2b422-232c-4c50-887e-576f05064d57 tempest-TestShelveInstance-1469316758 None] attachment_update completed successfully.
Nov 14 03:33:32 devstack sudo[96560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:33:32 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:32 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.709s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebc2456-c344-4d17-9f8a-b619413dcfb2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:33 devstack sudo[96565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:33:33 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:33 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.751s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:33 devstack sudo[96570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img
Nov 14 03:33:33 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:36 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img" returned: 0 in 2.828s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:36 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[95882139-f1ae-42ae-ad68-e812d535f5ef]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:36 devstack sudo[96598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:33:36 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:37 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.833s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:37 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c, size 1024.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:33:37 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Converted 1024.00 MB image at 361.87 MB/s
Nov 14 03:33:37 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] 7b24e64d-6041-4ae6-b47a-35f475e37ffe was raw, converting to qcow2 {{(pid=80846) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Nov 14 03:33:37 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc6a3a-311f-4f9e-8d1b-3741df3bbf9a]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:37 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img
Nov 14 03:33:37 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:38 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img" returned: 0 in 0.668s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:38 devstack sudo[96611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img
Nov 14 03:33:38 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:38 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img" returned: 1 in 0.642s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:33:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img /opt/stack/data/cinder/conversion/vol_upload_68g4nttk {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:38 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img /opt/stack/data/cinder/conversion/vol_upload_68g4nttk
Nov 14 03:33:38 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:39 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img /opt/stack/data/cinder/conversion/vol_upload_68g4nttk" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:39 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Image conversion details: src /opt/stack/data/cinder/conversion/e1643028-43ff-4b92-92af-673fdf05f04c.temp_image.7b24e64d-6041-4ae6-b47a-35f475e37ffefnwvi4qr.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_68g4nttk {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:33:39 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 14 03:33:39 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae58b0f-bf23-4306-98ab-4535b423eb15]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_68g4nttk {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:39 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_68g4nttk
Nov 14 03:33:39 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:40 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_68g4nttk" returned: 0 in 1.022s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.276s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Uploaded volume to glance image-id: 7b24e64d-6041-4ae6-b47a-35f475e37ffe. {{(pid=80846) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Nov 14 03:33:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-04bbf192-f302-42ba-a50d-0f9d210a7ecf tempest-VolumesActionsTest-1559513615 None] Copy volume to image completed successfully.
Nov 14 03:33:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Acquiring lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:33:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:33:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Acquiring lock "cinder-quobyte-e1643028-43ff-4b92-92af-673fdf05f04c" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:33:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-quobyte-e1643028-43ff-4b92-92af-673fdf05f04c" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:33:43 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[513d1926-df5e-4231-af1a-bc7a29990160]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:43 devstack sudo[97121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:33:43 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:44 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.978s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:44 devstack sudo[97151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c
Nov 14 03:33:44 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:44 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e1643028-43ff-4b92-92af-673fdf05f04c" returned: 0 in 0.653s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-quobyte-e1643028-43ff-4b92-92af-673fdf05f04c" released by "delete_volume" :: held 1.716s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Created reservations ['f87856b0-8cd6-4ab8-8fc4-71e648052af3', '534d0492-7b76-41ed-a99b-c29dcb32b4a8', '3e0432ba-0c49-41d7-a65d-188a30152f60', '2c4a6ebf-956c-417f-ac03-76b949b75acb'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:45 devstack sudo[97155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:33:45 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:45 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.477s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:33:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Deleted volume successfully.
Nov 14 03:33:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-82e41516-9fdd-4a28-9d4f-c8128a232549 tempest-VolumesActionsTest-1559513615 None] Lock "cinder-e1643028-43ff-4b92-92af-673fdf05f04c-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:33:49 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Flow 'volume_create_manager' (474cb860-af4c-44c1-bf82-90d53b9aa633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fbb02b-2527-4045-b85a-b38a3ca3e9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fbb02b-2527-4045-b85a-b38a3ca3e9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1024058290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ff17b4-e998-468f-8c38-46c4875723d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2997f885b2439caff439dd5f0ef020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:33:49Z,use_quota=True,user_id='c8836ef92bfc4eb7a1bc4043ae20d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22266556-1975-4267-8b5f-eef65ca171cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22266556-1975-4267-8b5f-eef65ca171cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77d6de6-b75f-4d90-98cb-939b2e162a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77d6de6-b75f-4d90-98cb-939b2e162a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ff17b4-e998-468f-8c38-46c4875723d7', 'volume_name': 'volume-78ff17b4-e998-468f-8c38-46c4875723d7', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20931f4d-88cf-4f0c-8a61-9641e79fec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20931f4d-88cf-4f0c-8a61-9641e79fec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c808993b-35ca-42a4-ae25-9b680ee708ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:49 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Volume 78ff17b4-e998-468f-8c38-46c4875723d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ff17b4-e998-468f-8c38-46c4875723d7', 'volume_size': 1}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1024058290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ff17b4-e998-468f-8c38-46c4875723d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2997f885b2439caff439dd5f0ef020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:33:49Z,use_quota=True,user_id='c8836ef92bfc4eb7a1bc4043ae20d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Creating volume 78ff17b4-e998-468f-8c38-46c4875723d7 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:33:49 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:49 devstack sudo[97198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7 1073741824
Nov 14 03:33:49 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:49 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7 1073741824" returned: 0 in 0.620s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:49 devstack sudo[97203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7
Nov 14 03:33:49 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:50 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Flow 'volume_create_manager' (a2e51a63-55b9-4414-bcef-f51ddee9a65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbb19ef-20d4-4f29-9aa3-64aace271d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbb19ef-20d4-4f29-9aa3-64aace271d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-248391398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eeef0f-ea7d-445d-ac36-65a4af60b504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2b75bbcdad43fe8dba9d8fd0cb929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:33:50Z,use_quota=True,user_id='49cf10e5b5004da19c17776ca88cf66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1171c0-04bd-4352-aca9-b2aea659b57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1171c0-04bd-4352-aca9-b2aea659b57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80b7f1c-ab58-4084-b253-d7f73284f438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80b7f1c-ab58-4084-b253-d7f73284f438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87eeef0f-ea7d-445d-ac36-65a4af60b504', 'volume_name': 'volume-87eeef0f-ea7d-445d-ac36-65a4af60b504', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61eab549-22ab-473d-9d4d-fc1c0b3d4e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61eab549-22ab-473d-9d4d-fc1c0b3d4e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98125c5a-a6a9-4944-a1c8-a3381b31b678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:50 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume 87eeef0f-ea7d-445d-ac36-65a4af60b504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87eeef0f-ea7d-445d-ac36-65a4af60b504', 'volume_size': 1}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:50 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7" returned: 0 in 0.475s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-248391398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eeef0f-ea7d-445d-ac36-65a4af60b504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2b75bbcdad43fe8dba9d8fd0cb929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:33:50Z,use_quota=True,user_id='49cf10e5b5004da19c17776ca88cf66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Creating volume 87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:33:50 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c808993b-35ca-42a4-ae25-9b680ee708ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ff17b4-e998-468f-8c38-46c4875723d7', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cc078a-ae69-4cb6-9333-cfed6ba04878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:50 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 1073741824
Nov 14 03:33:50 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:50 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Volume volume-78ff17b4-e998-468f-8c38-46c4875723d7 (78ff17b4-e998-468f-8c38-46c4875723d7): created successfully
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cc078a-ae69-4cb6-9333-cfed6ba04878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Flow 'volume_create_manager' (474cb860-af4c-44c1-bf82-90d53b9aa633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:33:50 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-288721e7-1c4d-49d3-a1fe-b798bc0716b9 tempest-ServersNegativeTestJSON-451216978 None] Created volume successfully.
Nov 14 03:33:50 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 1073741824" returned: 0 in 0.515s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:50 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504
Nov 14 03:33:50 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:51 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504" returned: 0 in 0.491s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98125c5a-a6a9-4944-a1c8-a3381b31b678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87eeef0f-ea7d-445d-ac36-65a4af60b504', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e392d6-e1d6-4ff3-959c-79fc08386690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:51 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 (87eeef0f-ea7d-445d-ac36-65a4af60b504): created successfully
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e392d6-e1d6-4ff3-959c-79fc08386690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Flow 'volume_create_manager' (a2e51a63-55b9-4414-bcef-f51ddee9a65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:33:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c534acb5-3a1d-4c65-bd80-ce941ae9a9d8 tempest-VolumesSnapshotListTestJSON-1949845653 None] Created volume successfully.
Nov 14 03:33:51 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Flow 'volume_create_manager' (100fe493-3d51-4169-9f15-702b21c51b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64145906-c6e3-4e64-a3da-3ed710201ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64145906-c6e3-4e64-a3da-3ed710201ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-764630540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88417a4-aa38-4668-a2cb-fea58ad03a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2997f885b2439caff439dd5f0ef020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:33:52Z,use_quota=True,user_id='c8836ef92bfc4eb7a1bc4043ae20d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dba156-aae2-4ed6-89bf-ce6f237cb3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dba156-aae2-4ed6-89bf-ce6f237cb3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26089a56-2986-46aa-9355-74b86ff7ab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26089a56-2986-46aa-9355-74b86ff7ab9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88417a4-aa38-4668-a2cb-fea58ad03a35', 'volume_name': 'volume-b88417a4-aa38-4668-a2cb-fea58ad03a35', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0cf02b-7b81-4643-abbd-78539534fac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0cf02b-7b81-4643-abbd-78539534fac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3896766-c99a-4fa4-ab14-08b7e0a9da75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:52 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Volume b88417a4-aa38-4668-a2cb-fea58ad03a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88417a4-aa38-4668-a2cb-fea58ad03a35', 'volume_size': 1}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-764630540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88417a4-aa38-4668-a2cb-fea58ad03a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2997f885b2439caff439dd5f0ef020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:33:52Z,use_quota=True,user_id='c8836ef92bfc4eb7a1bc4043ae20d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Creating volume b88417a4-aa38-4668-a2cb-fea58ad03a35 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:33:52 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:52 devstack sudo[97215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35 1073741824
Nov 14 03:33:52 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:52 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35 1073741824" returned: 0 in 0.637s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:52 devstack sudo[97220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35
Nov 14 03:33:52 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:53 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35" returned: 0 in 0.476s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.820s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Creating offline snapshot 67bab3b8-35e1-472e-975d-6f0d32c455a2 of volume 87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3896766-c99a-4fa4-ab14-08b7e0a9da75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88417a4-aa38-4668-a2cb-fea58ad03a35', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea130275-0eda-432e-a741-017e994f2f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0866f7a5-5fdb-46e4-a41b-cf79fb081780]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:53 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Volume volume-b88417a4-aa38-4668-a2cb-fea58ad03a35 (b88417a4-aa38-4668-a2cb-fea58ad03a35): created successfully
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea130275-0eda-432e-a741-017e994f2f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Flow 'volume_create_manager' (100fe493-3d51-4169-9f15-702b21c51b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:33:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-67d72e10-25d5-4c6c-9cf3-97da51f1d08d tempest-ServersNegativeTestJSON-451216978 None] Created volume successfully.
Nov 14 03:33:53 devstack sudo[97223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504
Nov 14 03:33:53 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:53 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504" returned: 0 in 0.558s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:53 devstack sudo[97228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 1G
Nov 14 03:33:53 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:54 devstack sudo[97233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:33:54 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:54 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 1G" returned: 0 in 0.590s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:54 devstack sudo[97235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2
Nov 14 03:33:54 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "cinder-b88417a4-aa38-4668-a2cb-fea58ad03a35-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Lock "cinder-b88417a4-aa38-4668-a2cb-fea58ad03a35-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:33:54 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "cinder-quobyte-b88417a4-aa38-4668-a2cb-fea58ad03a35" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Lock "cinder-quobyte-b88417a4-aa38-4668-a2cb-fea58ad03a35" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2427ecf5-0f36-40d7-b39f-0946a23eac5d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:54 devstack sudo[97237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35
Nov 14 03:33:54 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:54 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.706s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:33:55 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2" returned: 0 in 0.704s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:55 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 is being set with open permissions: ugo+rw
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:55 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2
Nov 14 03:33:55 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:55 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35" returned: 0 in 0.730s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:55 devstack sudo[97248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35
Nov 14 03:33:55 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:55 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2" returned: 0 in 0.449s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:55 devstack sudo[97251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.info
Nov 14 03:33:55 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:55 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-b88417a4-aa38-4668-a2cb-fea58ad03a35" returned: 0 in 0.549s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Lock "cinder-quobyte-b88417a4-aa38-4668-a2cb-fea58ad03a35" released by "delete_volume" :: held 1.315s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Created reservations ['cc064359-fd5b-4668-ac6b-60840c9a3f45', '72610d9e-c8cb-44f9-9978-4339354ef29d', 'ad63c053-4c43-415d-8fc6-8f151495ca29', '9e52f247-b039-47d5-8afd-fa65957b1bac'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:55 devstack sudo[97255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:33:55 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:55 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.info" returned: 0 in 0.511s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:55 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.info is being set with open permissions: ugo+rw
Nov 14 03:33:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:56 devstack sudo[97257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.info
Nov 14 03:33:56 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:56 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.487s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:33:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Deleted volume successfully.
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0be36405-1014-4661-90c7-e462446ecc11 tempest-ServersNegativeTestJSON-451216978 None] Lock "cinder-b88417a4-aa38-4668-a2cb-fea58ad03a35-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:33:56 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.info" returned: 0 in 0.457s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.322s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6fd09c8e-8840-40e6-a3b8-6bc31cf3e0c3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Create snapshot completed successfully
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "cinder-78ff17b4-e998-468f-8c38-46c4875723d7-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Lock "cinder-78ff17b4-e998-468f-8c38-46c4875723d7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:33:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "cinder-quobyte-78ff17b4-e998-468f-8c38-46c4875723d7" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Lock "cinder-quobyte-78ff17b4-e998-468f-8c38-46c4875723d7" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea4dd55-84ed-40c1-926e-b67fc66d7103]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:56 devstack sudo[97261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7
Nov 14 03:33:56 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:57 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7" returned: 0 in 0.566s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:57 devstack sudo[97266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7
Nov 14 03:33:57 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Creating offline snapshot 34aa605c-5381-44ed-b080-0f12161d0ce5 of volume 87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99112a9-9c4b-4fbf-bb40-27fde3da2ba5]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:57 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-78ff17b4-e998-468f-8c38-46c4875723d7" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Lock "cinder-quobyte-78ff17b4-e998-468f-8c38-46c4875723d7" released by "delete_volume" :: held 1.079s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Created reservations ['dc4ce241-028f-4d4d-a9a2-d754acbcddd7', '77c93833-d3a6-44fd-8c46-fe67ec84f7bb', '19ddce09-4038-4567-afb8-aaec97164149', '9623600a-93cf-4087-8717-0137e5535c1f'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:57 devstack sudo[97269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2
Nov 14 03:33:57 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:57 devstack sudo[97271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:33:57 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:58 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2" returned: 0 in 0.590s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eeef0f-ea7d-445d-ac36-65a4af60b504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:33:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:58 devstack sudo[97276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 1G
Nov 14 03:33:58 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:58 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.662s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:58 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:33:58 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Deleted volume successfully.
Nov 14 03:33:58 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a76dc728-8d2e-4e8e-abf3-6ed9d23367e2 tempest-ServersNegativeTestJSON-451216978 None] Lock "cinder-78ff17b4-e998-468f-8c38-46c4875723d7-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:33:58 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 1G" returned: 0 in 0.543s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:58 devstack sudo[97282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5
Nov 14 03:33:58 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:59 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5" returned: 0 in 0.517s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:59 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 is being set with open permissions: ugo+rw
Nov 14 03:33:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:33:59 devstack sudo[97287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5
Nov 14 03:33:59 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:33:59 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root
Nov 14 03:33:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5" returned: 0 in 0.440s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:33:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:33:59 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-376d2948-d7d4-4c6f-89b3-4e84c9aedc21 tempest-VolumesSnapshotListTestJSON-1949845653 None] Create snapshot completed successfully
Nov 14 03:34:00 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Creating offline snapshot 7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca of volume 87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:34:01 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[368dd2a4-138e-45c8-81d3-f34037748f5b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:01 devstack sudo[97349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5
Nov 14 03:34:01 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:01 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5" returned: 0 in 0.580s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eeef0f-ea7d-445d-ac36-65a4af60b504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:01 devstack sudo[97354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca 1G
Nov 14 03:34:01 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:02 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca 1G" returned: 0 in 0.636s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:02 devstack sudo[97360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca
Nov 14 03:34:02 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:02 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca" returned: 0 in 0.471s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:02 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca is being set with open permissions: ugo+rw
Nov 14 03:34:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:02 devstack sudo[97365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca
Nov 14 03:34:02 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:03 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca" returned: 0 in 0.487s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-66b942e2-fd1d-418d-b93e-c2ef081d0800 tempest-VolumesSnapshotListTestJSON-1949845653 None] Create snapshot completed successfully
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:04 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-quobyte-7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Deleting offline snapshot 7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca of volume 87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] snapshot_file for this snap is: volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ae1ee2-a867-4a0c-85cb-e1cf97245405]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:04 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca
Nov 14 03:34:04 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:05 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca" returned: 0 in 0.582s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eeef0f-ea7d-445d-ac36-65a4af60b504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:05 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243e067-f717-43c6-a3ab-f0a23661c2a5]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:05 devstack sudo[97388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5
Nov 14 03:34:05 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:05 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5" returned: 0 in 0.598s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eeef0f-ea7d-445d-ac36-65a4af60b504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:06 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca
Nov 14 03:34:06 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:06 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca" returned: 0 in 0.551s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:06 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca
Nov 14 03:34:06 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:07 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca" returned: 0 in 0.488s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca" released by "_delete_snapshot" :: held 2.290s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" released by "delete_snapshot" :: held 2.302s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:07 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Created reservations ['9f5a65a6-6424-40cf-97b4-31878ddeaf8a', '5a0ed466-85a8-4216-bed9-9dfc2f20d90c', 'efae5e13-4b46-4175-a6fd-e9bf0e091de2', 'd73120ac-e393-4768-9d4e-0dc61d561f29'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:07 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Delete snapshot completed successfully.
Nov 14 03:34:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-137b6c2e-c89b-45e9-aba1-d08c7ca9c6e1 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-7a2c28ab-c6a1-4687-97e4-5fa20f2eb9ca-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-34aa605c-5381-44ed-b080-0f12161d0ce5-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-34aa605c-5381-44ed-b080-0f12161d0ce5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:08 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" acquired by "delete_snapshot" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-quobyte-34aa605c-5381-44ed-b080-0f12161d0ce5" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-34aa605c-5381-44ed-b080-0f12161d0ce5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Deleting offline snapshot 34aa605c-5381-44ed-b080-0f12161d0ce5 of volume 87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] snapshot_file for this snap is: volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d210e-785d-4db3-a079-39881c84828c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:08 devstack sudo[97402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5
Nov 14 03:34:08 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:08 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5" returned: 0 in 0.665s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eeef0f-ea7d-445d-ac36-65a4af60b504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[73365fcb-cc6e-4bca-9051-3a50741f746d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:08 devstack sudo[97408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2
Nov 14 03:34:08 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:09 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2" returned: 0 in 0.653s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eeef0f-ea7d-445d-ac36-65a4af60b504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:09 devstack sudo[97413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5
Nov 14 03:34:09 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:10 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5" returned: 0 in 0.594s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:10 devstack sudo[97418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5
Nov 14 03:34:10 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:10 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.34aa605c-5381-44ed-b080-0f12161d0ce5" returned: 0 in 0.527s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-34aa605c-5381-44ed-b080-0f12161d0ce5" released by "_delete_snapshot" :: held 2.504s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" released by "delete_snapshot" :: held 2.520s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:10 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e942389d-cf26-49a7-8f26-3bbdea742d9c tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e942389d-cf26-49a7-8f26-3bbdea742d9c tempest-GroupSnapshotsTest-1448337580 None] Group tempest-GroupSnapshotsTest-Group-1433144121: creating
Nov 14 03:34:10 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Created reservations ['3457db7c-ef8a-406a-846f-0f2f5a83dbe0', 'fc428123-b138-4d23-a0d1-48078dd039a5', '711258d6-95d5-4a99-a54d-72cca181f8af', 'fa92398d-0454-41ed-8268-849449f8dfc1'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e942389d-cf26-49a7-8f26-3bbdea742d9c tempest-GroupSnapshotsTest-1448337580 None] Group tempest-GroupSnapshotsTest-Group-1433144121: created successfully
Nov 14 03:34:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e942389d-cf26-49a7-8f26-3bbdea742d9c tempest-GroupSnapshotsTest-1448337580 None] Create group completed successfully.
Nov 14 03:34:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Delete snapshot completed successfully.
Nov 14 03:34:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-1fceb211-59ad-42e2-8a98-0205a46dc9f3 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-34aa605c-5381-44ed-b080-0f12161d0ce5-delete_snapshot" released by "delete_snapshot" :: held 2.666s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-67bab3b8-35e1-472e-975d-6f0d32c455a2-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-67bab3b8-35e1-472e-975d-6f0d32c455a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-quobyte-67bab3b8-35e1-472e-975d-6f0d32c455a2" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-67bab3b8-35e1-472e-975d-6f0d32c455a2" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Deleting offline snapshot 67bab3b8-35e1-472e-975d-6f0d32c455a2 of volume 87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] snapshot_file for this snap is: volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b852df-f110-4b09-a01f-b0d6e82e083c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:11 devstack sudo[97422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2
Nov 14 03:34:11 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:11 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2" returned: 0 in 0.680s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eeef0f-ea7d-445d-ac36-65a4af60b504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0b2f12-eb96-40df-8616-c41768a56bc9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Flow 'volume_create_manager' (2abb12a9-5689-46ec-a346-a751c5f95d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e262e791-e1d0-414b-90c6-a98aa49ed6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e262e791-e1d0-414b-90c6-a98aa49ed6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680032947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f6772efe-7b5f-45de-8a23-22509c6a563a,host='devstack@QuobyteHD#QuobyteHD',id=4e961d60-9e7c-488b-bf19-87157fc8f823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db34f5c15574a82bed96c6a527b7a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:34:12Z,use_quota=True,user_id='ff6a0f8ec70e4fbbb7c37e00afc907c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23d0b0c8-4544-478c-a5ae-7728553c6b15),volume_type_id=23d0b0c8-4544-478c-a5ae-7728553c6b15)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f71eb0-35f2-4470-9b54-f5c29bfb8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f71eb0-35f2-4470-9b54-f5c29bfb8b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c699cba-634e-410a-ba70-94516121f340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c699cba-634e-410a-ba70-94516121f340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e961d60-9e7c-488b-bf19-87157fc8f823', 'volume_name': 'volume-4e961d60-9e7c-488b-bf19-87157fc8f823', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c0932b-509b-4eac-87ab-13f476890c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c0932b-509b-4eac-87ab-13f476890c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc507839-bb91-4a17-8e84-f99ecd402d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Volume 4e961d60-9e7c-488b-bf19-87157fc8f823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e961d60-9e7c-488b-bf19-87157fc8f823', 'volume_size': 1}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f6772efe-7b5f-45de-8a23-22509c6a563a,created_at=2025-11-14T02:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680032947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f6772efe-7b5f-45de-8a23-22509c6a563a,host='devstack@QuobyteHD#QuobyteHD',id=4e961d60-9e7c-488b-bf19-87157fc8f823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db34f5c15574a82bed96c6a527b7a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:34:12Z,use_quota=True,user_id='ff6a0f8ec70e4fbbb7c37e00afc907c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23d0b0c8-4544-478c-a5ae-7728553c6b15),volume_type_id=23d0b0c8-4544-478c-a5ae-7728553c6b15)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Creating volume 4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:34:12 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:12 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504
Nov 14 03:34:12 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:12 devstack sudo[97429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 1073741824
Nov 14 03:34:12 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:12 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504" returned: 0 in 0.668s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:12 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 1073741824" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:12 devstack sudo[97438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2
Nov 14 03:34:12 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:12 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823
Nov 14 03:34:12 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:13 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2" returned: 0 in 0.518s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:13 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2
Nov 14 03:34:13 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:13 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823" returned: 0 in 0.518s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc507839-bb91-4a17-8e84-f99ecd402d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e961d60-9e7c-488b-bf19-87157fc8f823', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a03aff-9d47-4f0b-bd2f-3e6bd6c28742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Volume volume-4e961d60-9e7c-488b-bf19-87157fc8f823 (4e961d60-9e7c-488b-bf19-87157fc8f823): created successfully
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a03aff-9d47-4f0b-bd2f-3e6bd6c28742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Flow 'volume_create_manager' (2abb12a9-5689-46ec-a346-a751c5f95d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:34:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8e24e5ba-58d4-49fe-a658-87138f5215ed tempest-GroupSnapshotsTest-1448337580 None] Created volume successfully.
Nov 14 03:34:13 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504.67bab3b8-35e1-472e-975d-6f0d32c455a2" returned: 0 in 0.442s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-67bab3b8-35e1-472e-975d-6f0d32c455a2" released by "_delete_snapshot" :: held 2.369s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" released by "delete_snapshot" :: held 2.384s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Created reservations ['2cc5d0f3-2644-4121-a3fa-dc1332e39492', '70e11056-f95a-47b8-8e95-120a8a63b230', 'f37f064f-7669-4d70-85be-fa1776d6a218', '8d5df550-6379-4006-9535-6c3549fd9251'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Delete snapshot completed successfully.
Nov 14 03:34:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fc88a14d-70e2-48f7-963e-7a9fa5afb179 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-67bab3b8-35e1-472e-975d-6f0d32c455a2-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] GroupSnapshot 199a54cb-22a1-4c29-b0d1-64eb48521aad: creating.
Nov 14 03:34:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Group snapshot 199a54cb-22a1-4c29-b0d1-64eb48521aad: creating. {{(pid=80846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Creating offline snapshot 6efbc292-4f41-4863-bccb-e08ff58d227e of volume 4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0acc0-1bd5-4df2-8629-70b75beaff2f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-87eeef0f-ea7d-445d-ac36-65a4af60b504-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-87eeef0f-ea7d-445d-ac36-65a4af60b504-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe7ceb1-3c06-4dbb-a4db-85bc26edebc2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:14 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823
Nov 14 03:34:14 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:14 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504
Nov 14 03:34:14 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:14 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823" returned: 0 in 0.603s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:14 devstack sudo[97456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e 1G
Nov 14 03:34:14 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:15 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:15 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504
Nov 14 03:34:15 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:15 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e 1G" returned: 0 in 0.530s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e961d60-9e7c-488b-bf19-87157fc8f823 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:15 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e961d60-9e7c-488b-bf19-87157fc8f823 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e
Nov 14 03:34:15 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:15 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87eeef0f-ea7d-445d-ac36-65a4af60b504" returned: 0 in 0.481s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-quobyte-87eeef0f-ea7d-445d-ac36-65a4af60b504" released by "delete_volume" :: held 1.078s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Created reservations ['3575bfde-830a-43e6-9234-36d2a5cce510', '36570f8c-450f-45b3-b534-c4a4eb869205', 'a368439b-395f-4a58-9415-37b730410ca2', 'de045a97-fa95-4b5f-b1ad-674225447111'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:15 devstack sudo[97470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:34:15 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:15 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e961d60-9e7c-488b-bf19-87157fc8f823 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e" returned: 0 in 0.500s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:15 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:34:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:16 devstack sudo[97475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e
Nov 14 03:34:16 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:16 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.461s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:16 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:34:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Deleted volume successfully.
Nov 14 03:34:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c491e0e2-9c4a-4d45-b839-d66d59730908 tempest-VolumesSnapshotListTestJSON-1949845653 None] Lock "cinder-87eeef0f-ea7d-445d-ac36-65a4af60b504-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:16 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e" returned: 0 in 0.443s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:16 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.info
Nov 14 03:34:16 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:16 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.info" returned: 0 in 0.453s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:16 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:34:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:16 devstack sudo[97482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.info
Nov 14 03:34:16 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:17 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.info" returned: 0 in 0.493s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:17 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=56,cinder:UPDATE=45,cinder:INSERT=12,cinder:DELETE=6 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:34:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8034f2f4-171e-4865-82e3-69e66c783a67 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 199a54cb-22a1-4c29-b0d1-64eb48521aad: created successfully
Nov 14 03:34:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Flow 'volume_create_manager' (c0692cdf-19bb-46be-8525-e97f2697fe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ec647f-85f7-4879-bb30-97ea8e26034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ec647f-85f7-4879-bb30-97ea8e26034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1661675314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824ca2d0-7f47-4f60-a6b4-5766dd9cb210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d130a1799b45f98ea820cf1ae2dace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:34:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:34:18Z,use_quota=True,user_id='d7ca3a7ffa804ae49ce2a05025bbad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85cc359-b6b1-45b8-8eb9-6c11d812f56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85cc359-b6b1-45b8-8eb9-6c11d812f56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2125b420-7d37-43ce-9a50-caa64290176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2125b420-7d37-43ce-9a50-caa64290176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824ca2d0-7f47-4f60-a6b4-5766dd9cb210', 'volume_name': 'volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210', 'volume_size': 2}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eb997f-4b42-4fc7-9799-cc0f0fd27256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eb997f-4b42-4fc7-9799-cc0f0fd27256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83eaf793-beb9-49de-98e8-6eb7ec1ff9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:18 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Volume 824ca2d0-7f47-4f60-a6b4-5766dd9cb210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210', 'volume_size': 2}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1661675314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824ca2d0-7f47-4f60-a6b4-5766dd9cb210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d130a1799b45f98ea820cf1ae2dace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:34:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:34:18Z,use_quota=True,user_id='d7ca3a7ffa804ae49ce2a05025bbad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Creating volume 824ca2d0-7f47-4f60-a6b4-5766dd9cb210 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:34:18 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 2147483648 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:18 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 2147483648
Nov 14 03:34:18 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:18 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 2147483648" returned: 0 in 0.562s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:19 devstack sudo[97490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210
Nov 14 03:34:19 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:19 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:19 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" returned: 0 in 0.486s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.130s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-6efbc292-4f41-4863-bccb-e08ff58d227e-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83eaf793-beb9-49de-98e8-6eb7ec1ff9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210', 'volume_size': 2}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad759fe-b2fb-4b00-be76-2686c940b660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-6efbc292-4f41-4863-bccb-e08ff58d227e-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Creating volume 05aa68ac-d62b-4f8b-aab7-9ab55b79f14d from snapshot 6efbc292-4f41-4863-bccb-e08ff58d227e {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Volume volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 (824ca2d0-7f47-4f60-a6b4-5766dd9cb210): created successfully
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad759fe-b2fb-4b00-be76-2686c940b660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Flow 'volume_create_manager' (c0692cdf-19bb-46be-8525-e97f2697fe61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] snapshot: 6efbc292-4f41-4863-bccb-e08ff58d227e, volume: 05aa68ac-d62b-4f8b-aab7-9ab55b79f14d,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:34:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7b223c85-ab4e-4661-bcfc-19c9cb41d56a tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Created volume successfully.
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd38743-e10a-47c0-b43d-0f456e795bd4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:19 devstack sudo[97493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e
Nov 14 03:34:19 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:20 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e" returned: 0 in 0.560s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e961d60-9e7c-488b-bf19-87157fc8f823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[43578ec5-4d7f-45f9-bcc9-6daeb56c34a1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:20 devstack sudo[97498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823
Nov 14 03:34:20 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:20 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823" returned: 0 in 0.624s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:34:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:20 devstack sudo[97504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d
Nov 14 03:34:20 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:23 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" returned: 0 in 2.521s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:23 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0123b8dd-f449-425e-ad44-17cdc71051ad]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:23 devstack sudo[97556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823
Nov 14 03:34:23 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:23 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823" returned: 0 in 0.709s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:23 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:34:23 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Converted 1024.00 MB image at 405.87 MB/s
Nov 14 03:34:23 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:34:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:24 devstack sudo[97564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d
Nov 14 03:34:24 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:24 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" returned: 0 in 0.426s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" released by "_copy_volume_from_snapshot" :: held 4.911s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-6efbc292-4f41-4863-bccb-e08ff58d227e-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" released by "_create_volume_from_snapshot" :: held 4.937s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.959s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.855s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Creating offline snapshot c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 of volume 824ca2d0-7f47-4f60-a6b4-5766dd9cb210 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:34:24 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ceffe-fa73-4e8a-b471-b3a7b798dbcf]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:24 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b549315e-5ae4-432c-80aa-401accdd26b5 tempest-GroupSnapshotsTest-1448337580 None] Create group from source-snapshot-199a54cb-22a1-4c29-b0d1-64eb48521aad completed successfully.
Nov 14 03:34:24 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210
Nov 14 03:34:24 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:25 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" returned: 0 in 0.569s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 2G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:25 devstack sudo[97578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 2G
Nov 14 03:34:25 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f495d8d-bc14-40d6-8c74-a13c47ebfe02]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:25 devstack sudo[97581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d
Nov 14 03:34:25 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:25 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 2G" returned: 0 in 0.567s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:25 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2
Nov 14 03:34:25 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:25 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" returned: 0 in 0.579s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:25 devstack sudo[97598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d
Nov 14 03:34:25 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:26 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2" returned: 0 in 0.452s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:26 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 is being set with open permissions: ugo+rw
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:26 devstack sudo[97603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2
Nov 14 03:34:26 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:26 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" returned: 0 in 0.454s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-05aa68ac-d62b-4f8b-aab7-9ab55b79f14d" released by "delete_volume" :: held 1.070s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['8c6afbfe-380a-4dda-8376-0a6eed024e95'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:26 devstack cinder-volume[80846]: WARNING cinder.quota [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-904537812 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-904537812, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:34:26 devstack cinder-volume[80846]: WARNING cinder.quota [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-904537812 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-904537812, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['1e23ea43-12ae-4c81-82a1-4cb0f4e6a4ce', '98c8475f-a1ed-4fd0-b489-16325cd1236c', 'b05d9c66-484b-4b45-b370-5bb0c8be43ab', '91a65d2c-1aab-4f21-bbd6-cb7abeeaee10'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:26 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:34:26 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:26 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2" returned: 0 in 0.444s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:26 devstack sudo[97609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.info
Nov 14 03:34:26 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:26 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.444s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:34:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-40eceb23-3ac8-46cf-b0bb-10ada9e0bc46 tempest-GroupSnapshotsTest-1448337580 None] Delete group completed successfully.
Nov 14 03:34:26 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.info" returned: 0 in 0.457s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:26 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.info is being set with open permissions: ugo+rw
Nov 14 03:34:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:26 devstack sudo[97613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.info
Nov 14 03:34:26 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:27 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.info" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.016s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-227089ee-7c1a-4986-bf87-1a0364754ef8 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Create snapshot completed successfully
Nov 14 03:34:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 199a54cb-22a1-4c29-b0d1-64eb48521aad: deleting
Nov 14 03:34:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 199a54cb-22a1-4c29-b0d1-64eb48521aad: deleting {{(pid=80846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-4e961d60-9e7c-488b-bf19-87157fc8f823" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-4e961d60-9e7c-488b-bf19-87157fc8f823" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-6efbc292-4f41-4863-bccb-e08ff58d227e" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-6efbc292-4f41-4863-bccb-e08ff58d227e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Deleting offline snapshot 6efbc292-4f41-4863-bccb-e08ff58d227e of volume 4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] snapshot_file for this snap is: volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac97ead7-adf1-4bc7-8c23-738cd42f3834]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:27 devstack sudo[97616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e
Nov 14 03:34:27 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "cinder-c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:28 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "cinder-quobyte-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-quobyte-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "cinder-quobyte-c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-quobyte-c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Deleting offline snapshot c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 of volume 824ca2d0-7f47-4f60-a6b4-5766dd9cb210 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] snapshot_file for this snap is: volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee315bc-ed3f-4540-b3b2-d7c60dbd76cb]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:28 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2
Nov 14 03:34:28 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:28 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e" returned: 0 in 0.591s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e961d60-9e7c-488b-bf19-87157fc8f823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f78ee-39e9-4e44-839a-e4ef8856e89c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:28 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823
Nov 14 03:34:28 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:28 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2" returned: 0 in 0.557s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b22ce5a-23f2-43a0-87ac-103a1a625ea3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:28 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823" returned: 0 in 0.558s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:28 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210
Nov 14 03:34:28 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:28 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e
Nov 14 03:34:28 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:29 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e" returned: 0 in 0.483s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:29 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" returned: 0 in 0.639s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:29 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e
Nov 14 03:34:29 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:29 devstack sudo[97643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2
Nov 14 03:34:29 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:29 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823.6efbc292-4f41-4863-bccb-e08ff58d227e" returned: 0 in 0.457s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-6efbc292-4f41-4863-bccb-e08ff58d227e" released by "_delete_snapshot" :: held 2.177s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-4e961d60-9e7c-488b-bf19-87157fc8f823" released by "delete_snapshot" :: held 2.191s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=79,cinder:UPDATE=100,cinder:DELETE=6,cinder:INSERT=16 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:34:29 devstack cinder-volume[80846]: WARNING cinder.quota [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-904537812 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-904537812, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:34:29 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2" returned: 0 in 0.516s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:29 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['4f5c9206-07c6-40fa-954d-ba485457d68d', 'b9971307-08ff-4e0a-aae4-a3ec526bbb68', '54fd4f3f-38f6-45cd-9e22-953d662c7e53', '4bce55a3-18b2-4115-9ac8-c2eb8a7083f1'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:29 devstack sudo[97649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2
Nov 14 03:34:29 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-da17d2be-b42c-4185-b48e-3b0a7312bf19 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 199a54cb-22a1-4c29-b0d1-64eb48521aad: deleted successfully
Nov 14 03:34:30 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210.c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2" returned: 0 in 0.465s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-quobyte-c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2" released by "_delete_snapshot" :: held 2.253s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-quobyte-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" released by "delete_snapshot" :: held 2.263s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Created reservations ['4a5fc9f7-cac7-4d2e-a12d-56ed7b226c9e', 'b08eb4f4-f1d6-41b7-9080-e9a730cd75a1', '528b8a77-ddfe-4fed-a365-184f018b0188', '5d454aa8-baf8-44e4-96f4-47696c789743'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:30 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Delete snapshot completed successfully.
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-33684bd4-7ffa-4d01-879a-4622cbb10625 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-c6cecc1c-266e-45b7-9f24-91ba1b4e8ab2-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-4e961d60-9e7c-488b-bf19-87157fc8f823" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-4e961d60-9e7c-488b-bf19-87157fc8f823" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd18c7f7-83ec-4576-8e88-309cf671d246]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:31 devstack sudo[97653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823
Nov 14 03:34:31 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "cinder-824ca2d0-7f47-4f60-a6b4-5766dd9cb210-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-824ca2d0-7f47-4f60-a6b4-5766dd9cb210-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:31 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "cinder-quobyte-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-quobyte-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" acquired by "delete_volume" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa8f7b8-7cad-47ea-8563-02f77c82b9d8]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:31 devstack sudo[97655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210
Nov 14 03:34:31 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:31 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:31 devstack sudo[97660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823
Nov 14 03:34:31 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:31 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" returned: 0 in 0.565s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:31 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210
Nov 14 03:34:31 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:31 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4e961d60-9e7c-488b-bf19-87157fc8f823" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-4e961d60-9e7c-488b-bf19-87157fc8f823" released by "delete_volume" :: held 1.094s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['fab50926-17c3-4135-a113-5bbacc90a3c9'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:32 devstack cinder-volume[80846]: WARNING cinder.db.sqlalchemy.api [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-904537812']
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['2fe7f2cb-8b4d-4d75-999b-33542b5d7386', 'b4b0ad90-2d5f-4a85-9220-101dd4d02f81', '06fa4ca6-3f82-4cdf-83f4-2077a5c1fe83', 'ec4e280b-0fd6-45f0-ad1f-00765c9850c8'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:32 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:34:32 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:32 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" returned: 0 in 0.459s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-quobyte-824ca2d0-7f47-4f60-a6b4-5766dd9cb210" released by "delete_volume" :: held 1.063s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Created reservations ['2f529462-f75c-4904-b27d-792ab5d33bd8', '9deff1dc-7f2d-429f-b00f-cca5c709732e', '7070fa7f-370c-4a2e-b691-d6ee9a33a07a', '3683d743-3c62-4316-a80b-02ab2dde71fb'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:32 devstack sudo[97671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:34:32 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:32 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.462s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:34:32 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b729e77d-b932-4c3b-927c-d29de47ed869 tempest-GroupSnapshotsTest-1448337580 None] Delete group completed successfully.
Nov 14 03:34:32 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.442s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:34:32 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Deleted volume successfully.
Nov 14 03:34:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2612e714-e24c-4162-91b3-9800755d56f6 tempest-VolumesSnapshotNegativeTestJSON-1145867914 None] Lock "cinder-824ca2d0-7f47-4f60-a6b4-5766dd9cb210-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-591078df-035b-46c0-82e3-eeb8b094e460 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-591078df-035b-46c0-82e3-eeb8b094e460 tempest-GroupSnapshotsTest-1448337580 None] Group tempest-GroupSnapshotsTest-Group-1410435404: creating
Nov 14 03:34:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-591078df-035b-46c0-82e3-eeb8b094e460 tempest-GroupSnapshotsTest-1448337580 None] Group tempest-GroupSnapshotsTest-Group-1410435404: created successfully
Nov 14 03:34:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-591078df-035b-46c0-82e3-eeb8b094e460 tempest-GroupSnapshotsTest-1448337580 None] Create group completed successfully.
Nov 14 03:34:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Flow 'volume_create_manager' (10548692-e9d0-42a1-998b-a3fc32323a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a0ebfb-94dc-4bc6-96d3-64a0cd23a3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a0ebfb-94dc-4bc6-96d3-64a0cd23a3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1655591654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8db69f21-1a71-4318-b202-3bc8e3c22a09,host='devstack@QuobyteHD#QuobyteHD',id=1b7d9804-79ee-4a68-933d-d8fdc7e73fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db34f5c15574a82bed96c6a527b7a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:34:35Z,use_quota=True,user_id='ff6a0f8ec70e4fbbb7c37e00afc907c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee74fc6e-d8c4-4b09-8f9e-1e7552f80c67),volume_type_id=ee74fc6e-d8c4-4b09-8f9e-1e7552f80c67)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c24d1cf-831a-4f7d-841a-59904cd67bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c24d1cf-831a-4f7d-841a-59904cd67bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c877ce-58de-4f02-91c9-33f2ed181d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c877ce-58de-4f02-91c9-33f2ed181d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b7d9804-79ee-4a68-933d-d8fdc7e73fb5', 'volume_name': 'volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273dd738-1ab0-4a4b-b0da-68d43304ea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273dd738-1ab0-4a4b-b0da-68d43304ea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95623cdf-20ad-46e8-a3ba-2b5585c0b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:34 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Volume 1b7d9804-79ee-4a68-933d-d8fdc7e73fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5', 'volume_size': 1}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8db69f21-1a71-4318-b202-3bc8e3c22a09,created_at=2025-11-14T02:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1655591654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8db69f21-1a71-4318-b202-3bc8e3c22a09,host='devstack@QuobyteHD#QuobyteHD',id=1b7d9804-79ee-4a68-933d-d8fdc7e73fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db34f5c15574a82bed96c6a527b7a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:34:35Z,use_quota=True,user_id='ff6a0f8ec70e4fbbb7c37e00afc907c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee74fc6e-d8c4-4b09-8f9e-1e7552f80c67),volume_type_id=ee74fc6e-d8c4-4b09-8f9e-1e7552f80c67)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Creating volume 1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:34:34 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:34:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:34 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 1073741824
Nov 14 03:34:34 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:35 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 1073741824" returned: 0 in 0.592s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:35 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5
Nov 14 03:34:35 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:35 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" returned: 0 in 0.492s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95623cdf-20ad-46e8-a3ba-2b5585c0b730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e695c6f-3690-4128-92e8-8c513b449774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:35 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Volume volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 (1b7d9804-79ee-4a68-933d-d8fdc7e73fb5): created successfully
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e695c6f-3690-4128-92e8-8c513b449774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Flow 'volume_create_manager' (10548692-e9d0-42a1-998b-a3fc32323a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:34:35 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-367e9e15-6a12-4554-ad0c-f8675c518c67 tempest-GroupSnapshotsTest-1448337580 None] Created volume successfully.
Nov 14 03:34:37 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Flow 'volume_create_manager' (3f401788-b80f-4f28-8a36-6c32d787379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3f946c-ca16-46e3-96c0-d182d6761e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3f946c-ca16-46e3-96c0-d182d6761e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1541332156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8db69f21-1a71-4318-b202-3bc8e3c22a09,host='devstack@QuobyteHD#QuobyteHD',id=14f7bd4c-4b2b-4135-bca7-afa9555c8ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db34f5c15574a82bed96c6a527b7a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:34:37Z,use_quota=True,user_id='ff6a0f8ec70e4fbbb7c37e00afc907c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee74fc6e-d8c4-4b09-8f9e-1e7552f80c67),volume_type_id=ee74fc6e-d8c4-4b09-8f9e-1e7552f80c67)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9be766a-7353-40b5-8df6-d4409571dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9be766a-7353-40b5-8df6-d4409571dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d00c21-8fe0-4af5-9dc3-37346347f99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d00c21-8fe0-4af5-9dc3-37346347f99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f7bd4c-4b2b-4135-bca7-afa9555c8ed7', 'volume_name': 'volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64aa5fc8-bfe9-4f9a-b369-03ae5c10737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64aa5fc8-bfe9-4f9a-b369-03ae5c10737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a327106-a5ed-4a8a-95c6-71a7828e708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:37 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Volume 14f7bd4c-4b2b-4135-bca7-afa9555c8ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7', 'volume_size': 1}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8db69f21-1a71-4318-b202-3bc8e3c22a09,created_at=2025-11-14T02:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1541332156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8db69f21-1a71-4318-b202-3bc8e3c22a09,host='devstack@QuobyteHD#QuobyteHD',id=14f7bd4c-4b2b-4135-bca7-afa9555c8ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db34f5c15574a82bed96c6a527b7a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:34:37Z,use_quota=True,user_id='ff6a0f8ec70e4fbbb7c37e00afc907c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee74fc6e-d8c4-4b09-8f9e-1e7552f80c67),volume_type_id=ee74fc6e-d8c4-4b09-8f9e-1e7552f80c67)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Creating volume 14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:34:37 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:37 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 1073741824
Nov 14 03:34:37 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:37 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 1073741824" returned: 0 in 0.584s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:37 devstack sudo[97691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7
Nov 14 03:34:37 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:38 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" returned: 0 in 0.514s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:34:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a327106-a5ed-4a8a-95c6-71a7828e708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996cba01-3c5a-4321-bea0-ccbe9c7e5281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:34:38 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Volume volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 (14f7bd4c-4b2b-4135-bca7-afa9555c8ed7): created successfully
Nov 14 03:34:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996cba01-3c5a-4321-bea0-ccbe9c7e5281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:34:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Flow 'volume_create_manager' (3f401788-b80f-4f28-8a36-6c32d787379c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:34:38 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-729e1010-3fcd-4c6c-abf5-1b4912d3c7e8 tempest-GroupSnapshotsTest-1448337580 None] Created volume successfully.
Nov 14 03:34:39 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7b64b93d-e8a2-4ba3-9d55-5000d0a9ddd7 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:39 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7b64b93d-e8a2-4ba3-9d55-5000d0a9ddd7 tempest-GroupSnapshotsTest-1448337580 None] Update group completed successfully.
Nov 14 03:34:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3c702384-7d4c-46a9-af85-8d2dc1bdc070 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:40 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3c702384-7d4c-46a9-af85-8d2dc1bdc070 tempest-GroupSnapshotsTest-1448337580 None] Update group completed successfully.
Nov 14 03:34:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ba6a17dc-d929-46a5-ac55-583502914be8 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ba6a17dc-d929-46a5-ac55-583502914be8 tempest-GroupSnapshotsTest-1448337580 None] Update group completed successfully.
Nov 14 03:34:42 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-944ecb43-f0ca-4405-9be6-4354e255b9c0 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:42 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-944ecb43-f0ca-4405-9be6-4354e255b9c0 tempest-GroupSnapshotsTest-1448337580 None] Update group completed successfully.
Nov 14 03:34:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] GroupSnapshot 088876d3-1ab0-4b37-8952-e4e75b1fbc78: creating.
Nov 14 03:34:44 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Group snapshot 088876d3-1ab0-4b37-8952-e4e75b1fbc78: creating. {{(pid=80846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Nov 14 03:34:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Creating offline snapshot 4a7879ee-bf09-429a-a355-40e0f3acf4ca of volume 14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:34:44 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c5f80-ebdd-4c37-8731-05724afc9db6]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:44 devstack sudo[97697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7
Nov 14 03:34:44 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:44 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" returned: 0 in 0.646s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:44 devstack sudo[97702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca 1G
Nov 14 03:34:44 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:45 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca 1G" returned: 0 in 0.562s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:45 devstack sudo[97707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca
Nov 14 03:34:45 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:45 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca" returned: 0 in 0.553s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:45 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:34:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:45 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca
Nov 14 03:34:45 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:46 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca" returned: 0 in 0.547s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:46 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.info
Nov 14 03:34:46 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:46 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.info" returned: 0 in 0.490s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:46 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:34:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:46 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.info
Nov 14 03:34:46 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:47 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.info" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.367s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Creating offline snapshot 9363b52a-4031-4227-a9c1-54099893f702 of volume 1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:34:47 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f17c5cb-8260-4f1e-b6dc-ad1bb3e589d2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:47 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5
Nov 14 03:34:47 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:48 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" returned: 0 in 0.835s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:48 devstack sudo[97730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 1G
Nov 14 03:34:48 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:48 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 1G" returned: 0 in 0.644s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:48 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702
Nov 14 03:34:48 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:49 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702" returned: 0 in 0.571s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:49 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:34:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:49 devstack sudo[97742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702
Nov 14 03:34:49 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:50 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:50 devstack sudo[97748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.info
Nov 14 03:34:50 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:50 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.info" returned: 0 in 0.541s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:50 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:34:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:50 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.info
Nov 14 03:34:50 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:51 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.info" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.648s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1267f2ab-f5cb-4254-904c-e782aac831a4 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 088876d3-1ab0-4b37-8952-e4e75b1fbc78: created successfully
Nov 14 03:34:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 088876d3-1ab0-4b37-8952-e4e75b1fbc78: deleting
Nov 14 03:34:51 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 088876d3-1ab0-4b37-8952-e4e75b1fbc78: deleting {{(pid=80846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-4a7879ee-bf09-429a-a355-40e0f3acf4ca" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-4a7879ee-bf09-429a-a355-40e0f3acf4ca" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Deleting offline snapshot 4a7879ee-bf09-429a-a355-40e0f3acf4ca of volume 14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] snapshot_file for this snap is: volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36fa4cc-996e-4659-be23-157829984a1c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:51 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca
Nov 14 03:34:51 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:52 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca" returned: 0 in 0.651s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[812594ea-e2bf-4fe0-9eaa-c39d1a982762]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:52 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7
Nov 14 03:34:52 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:52 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" returned: 0 in 0.605s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:52 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca
Nov 14 03:34:52 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:53 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-b84dab09-ac8c-4194-9ba1-d2bb0a286bcc tempest-TestShelveInstance-1469316758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:53 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-b84dab09-ac8c-4194-9ba1-d2bb0a286bcc tempest-TestShelveInstance-1469316758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-b84dab09-ac8c-4194-9ba1-d2bb0a286bcc tempest-TestShelveInstance-1469316758 None] Terminate volume connection completed successfully.
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-b84dab09-ac8c-4194-9ba1-d2bb0a286bcc tempest-TestShelveInstance-1469316758 None] Deleting attachment 22332f5f-24b5-47e2-99b1-211897ec9d3a. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:34:53 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:53 devstack sudo[97803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca
Nov 14 03:34:53 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Acquiring lock "cinder-4db64091-645a-4d15-8105-e0e8b957436f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Lock "cinder-4db64091-645a-4d15-8105-e0e8b957436f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:53 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Acquiring lock "cinder-quobyte-4db64091-645a-4d15-8105-e0e8b957436f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Lock "cinder-quobyte-4db64091-645a-4d15-8105-e0e8b957436f" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f10b83-e079-4cd8-8950-e18eab1c743e]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:53 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7.4a7879ee-bf09-429a-a355-40e0f3acf4ca" returned: 0 in 0.487s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:53 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:34:53 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-4a7879ee-bf09-429a-a355-40e0f3acf4ca" released by "_delete_snapshot" :: held 2.384s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" released by "delete_snapshot" :: held 2.396s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-9363b52a-4031-4227-a9c1-54099893f702" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-9363b52a-4031-4227-a9c1-54099893f702" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Deleting offline snapshot 9363b52a-4031-4227-a9c1-54099893f702 of volume 1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] snapshot_file for this snap is: volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8ae06d-c90d-4106-a3bf-af7b2ee7406b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:54 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702
Nov 14 03:34:54 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:54 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:34:54 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:54 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 0 in 0.607s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:54 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:34:54 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:54 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702" returned: 0 in 0.731s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d324ab41-b688-4285-a120-3ca975daae4a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:54 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.498s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:34:54 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5
Nov 14 03:34:54 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:54 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 1 in 0.668s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:34:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:54 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f
Nov 14 03:34:54 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:55 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" returned: 0 in 0.661s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:55 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702
Nov 14 03:34:55 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:55 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4db64091-645a-4d15-8105-e0e8b957436f" returned: 0 in 0.540s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Lock "cinder-quobyte-4db64091-645a-4d15-8105-e0e8b957436f" released by "delete_volume" :: held 1.858s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG cinder.quota [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Created reservations ['7bdb3699-e692-48de-8526-e1e82b6381ee', '2d88a95f-3a19-4dad-91ae-0042464fdf5f', 'f60b4bf2-250b-4ade-8af2-1e159a6c1a68', '1fed69b4-2e6c-4daf-be0c-8200ae319f5b'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:55 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:34:55 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:55 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702" returned: 0 in 0.600s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:55 devstack sudo[97839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702
Nov 14 03:34:55 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:56 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.530s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:56 devstack cinder-volume[80846]: DEBUG cinder.manager [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:34:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Deleted volume successfully.
Nov 14 03:34:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [req-dc62364e-eadc-4dd4-881f-b54f626004c4 req-94208b20-a707-42d9-ae81-d0fd09a33c80 tempest-TestShelveInstance-1469316758 None] Lock "cinder-4db64091-645a-4d15-8105-e0e8b957436f-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:56 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5.9363b52a-4031-4227-a9c1-54099893f702" returned: 0 in 0.558s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-9363b52a-4031-4227-a9c1-54099893f702" released by "_delete_snapshot" :: held 2.633s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" released by "delete_snapshot" :: held 2.646s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:56 devstack cinder-volume[80846]: WARNING cinder.quota [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-13141092 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-13141092, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:34:56 devstack cinder-volume[80846]: WARNING cinder.quota [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-13141092 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-13141092, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:34:56 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['ffc2b521-eeeb-44e6-8344-5b4ff4f7ca3e', '157ca270-1916-4aea-a001-cb7e42a13ea8', '43ce048c-3697-4ff6-8078-d3c38b17a70b', 'd4ee24bb-cb31-4dea-8483-b672900af719'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:56 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['2ca8e309-9d4a-46be-b763-67e978e9f0e2', '4174b205-52d9-4091-a621-0e4d41697172', '32c834ac-c622-4d2c-afee-e6ed261d4854', '3c4e5176-b16f-4678-8621-398372a625b4'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:34:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4d4b38ca-bc56-472d-9a00-e75318cba6e3 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 088876d3-1ab0-4b37-8952-e4e75b1fbc78: deleted successfully
Nov 14 03:34:58 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:34:58 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:58 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:58 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd649d-5c57-49a2-a334-db311f8b5311]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:58 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7
Nov 14 03:34:58 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:58 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" returned: 0 in 0.626s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:58 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7
Nov 14 03:34:58 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:59 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" returned: 0 in 0.592s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-14f7bd4c-4b2b-4135-bca7-afa9555c8ed7" released by "delete_volume" :: held 1.263s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:34:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:34:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:34:59 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5a57f-3e64-41eb-898e-3a7181aa6f4c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:34:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:59 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5
Nov 14 03:34:59 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:34:59 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Nov 14 03:34:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" returned: 0 in 0.612s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:34:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:34:59 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5
Nov 14 03:34:59 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:00 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" returned: 0 in 0.523s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-1b7d9804-79ee-4a68-933d-d8fdc7e73fb5" released by "delete_volume" :: held 1.166s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['6fe62045-d065-495e-9e21-0828a683ab5d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:00 devstack cinder-volume[80846]: WARNING cinder.quota [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-13141092 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-13141092, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['83a85023-66fe-4a00-9a66-1571efde26e9', '790f7096-c964-40e3-97e9-51db415256de', '3b4df250-f28f-4a96-9392-f5027d7d48e8', '0ae9d181-d57d-48c1-a244-2673579ba8e6'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['595b37f4-936b-4c51-bed2-a3ecac65d18a', '832efdcd-dd68-41c5-98e6-d4af8738476d', '68d4ed4e-5046-4c90-8af5-da64a2e5e870', 'd9243079-7a19-4f77-96ab-50681134d976'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:00 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:35:00 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:01 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.800s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:01 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:35:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f160459c-112e-4447-831c-c6e3c47a329a tempest-GroupSnapshotsTest-1448337580 None] Delete group completed successfully.
Nov 14 03:35:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e223297a-33aa-42a3-83c3-2b7739191e0f tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e223297a-33aa-42a3-83c3-2b7739191e0f tempest-GroupSnapshotsTest-1448337580 None] Group tempest-GroupSnapshotsTest-Group-176467576: creating
Nov 14 03:35:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e223297a-33aa-42a3-83c3-2b7739191e0f tempest-GroupSnapshotsTest-1448337580 None] Group tempest-GroupSnapshotsTest-Group-176467576: created successfully
Nov 14 03:35:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e223297a-33aa-42a3-83c3-2b7739191e0f tempest-GroupSnapshotsTest-1448337580 None] Create group completed successfully.
Nov 14 03:35:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Flow 'volume_create_manager' (bf714d5c-6ec0-4f5c-be65-7d65a7cfc0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bf0cee-204f-45c1-b21c-46f1da4a2771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bf0cee-204f-45c1-b21c-46f1da4a2771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113005878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=80a84911-7dbd-4280-a419-fbf06c8e69a8,host='devstack@QuobyteHD#QuobyteHD',id=21104413-8ee9-46d9-bb71-b4d00422303b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db34f5c15574a82bed96c6a527b7a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:03Z,use_quota=True,user_id='ff6a0f8ec70e4fbbb7c37e00afc907c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1399bc6c-2da9-42ff-873c-534bb7bccdc6),volume_type_id=1399bc6c-2da9-42ff-873c-534bb7bccdc6)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d465172-1485-48f7-91d5-3e73bdc8d1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d465172-1485-48f7-91d5-3e73bdc8d1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d59efc1-35b0-4087-96cb-ceba02e83046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d59efc1-35b0-4087-96cb-ceba02e83046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21104413-8ee9-46d9-bb71-b4d00422303b', 'volume_name': 'volume-21104413-8ee9-46d9-bb71-b4d00422303b', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfed252f-0c6f-4752-beb6-6e5ddff3303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfed252f-0c6f-4752-beb6-6e5ddff3303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01014590-ab68-4f25-af41-268834618d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:03 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Volume 21104413-8ee9-46d9-bb71-b4d00422303b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21104413-8ee9-46d9-bb71-b4d00422303b', 'volume_size': 1}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=80a84911-7dbd-4280-a419-fbf06c8e69a8,created_at=2025-11-14T02:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113005878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=80a84911-7dbd-4280-a419-fbf06c8e69a8,host='devstack@QuobyteHD#QuobyteHD',id=21104413-8ee9-46d9-bb71-b4d00422303b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db34f5c15574a82bed96c6a527b7a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:03Z,use_quota=True,user_id='ff6a0f8ec70e4fbbb7c37e00afc907c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1399bc6c-2da9-42ff-873c-534bb7bccdc6),volume_type_id=1399bc6c-2da9-42ff-873c-534bb7bccdc6)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Creating volume 21104413-8ee9-46d9-bb71-b4d00422303b {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:35:03 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:35:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:03 devstack sudo[97967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b 1073741824
Nov 14 03:35:03 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:04 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Flow 'volume_create_manager' (c14baae4-cc9b-484e-adff-b24dc05314d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b75e5d-26ee-4e01-92df-96cc39c58bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b75e5d-26ee-4e01-92df-96cc39c58bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1257869355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8e8528-e19f-4910-883f-050115ef30d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2cc18cea7a44b89baac1c03f014d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:04Z,use_quota=True,user_id='60c4f5e0061c4ce78eaaf5323e0ced53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e32c714-5678-47a4-a9a5-6e918d7fe773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e32c714-5678-47a4-a9a5-6e918d7fe773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950e8a3d-7cf0-4e3d-8c23-f052b97d8fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950e8a3d-7cf0-4e3d-8c23-f052b97d8fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8e8528-e19f-4910-883f-050115ef30d9', 'volume_name': 'volume-4f8e8528-e19f-4910-883f-050115ef30d9', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2eb8f06-8fc2-4b30-8d6e-22f442033679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2eb8f06-8fc2-4b30-8d6e-22f442033679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb194f0-ec4c-4f6d-ba30-ef8b95d8514a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:04 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Volume 4f8e8528-e19f-4910-883f-050115ef30d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8e8528-e19f-4910-883f-050115ef30d9', 'volume_size': 1}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:04 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b 1073741824" returned: 0 in 0.770s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:04 devstack sudo[97972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b
Nov 14 03:35:04 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:04 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b" returned: 0 in 0.520s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1257869355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8e8528-e19f-4910-883f-050115ef30d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2cc18cea7a44b89baac1c03f014d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:04Z,use_quota=True,user_id='60c4f5e0061c4ce78eaaf5323e0ced53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Creating volume 4f8e8528-e19f-4910-883f-050115ef30d9 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:35:04 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01014590-ab68-4f25-af41-268834618d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21104413-8ee9-46d9-bb71-b4d00422303b', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:04 devstack sudo[97975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9 1073741824
Nov 14 03:35:04 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5956e44b-9e96-4184-b9b0-9f4ae616f054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:04 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Volume volume-21104413-8ee9-46d9-bb71-b4d00422303b (21104413-8ee9-46d9-bb71-b4d00422303b): created successfully
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5956e44b-9e96-4184-b9b0-9f4ae616f054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Flow 'volume_create_manager' (bf714d5c-6ec0-4f5c-be65-7d65a7cfc0e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e1ffec85-3473-4a7b-a5d5-d154481bc5a6 tempest-GroupSnapshotsTest-1448337580 None] Created volume successfully.
Nov 14 03:35:05 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9 1073741824" returned: 0 in 0.650s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:05 devstack sudo[97980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9
Nov 14 03:35:05 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:05 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] GroupSnapshot 8c07c89c-786f-4daa-9741-448f83c543ff: creating.
Nov 14 03:35:05 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Group snapshot 8c07c89c-786f-4daa-9741-448f83c543ff: creating. {{(pid=80846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Nov 14 03:35:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:06 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.249s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb194f0-ec4c-4f6d-ba30-ef8b95d8514a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8e8528-e19f-4910-883f-050115ef30d9', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c93bd3c-a76c-41b6-af4a-feedab71bde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Creating offline snapshot 4ca5af8d-d5fa-4442-ae03-ccc153337b8a of volume 21104413-8ee9-46d9-bb71-b4d00422303b {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:35:06 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Volume volume-4f8e8528-e19f-4910-883f-050115ef30d9 (4f8e8528-e19f-4910-883f-050115ef30d9): created successfully
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c93bd3c-a76c-41b6-af4a-feedab71bde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Flow 'volume_create_manager' (c14baae4-cc9b-484e-adff-b24dc05314d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1667f3-8f56-4cb3-83d8-5b72de625bbe]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-442445aa-b87b-4d17-96a3-fcc538bdc9ff tempest-TestMinimumBasicScenario-260141506 None] Created volume successfully.
Nov 14 03:35:06 devstack sudo[97983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b
Nov 14 03:35:06 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:06 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b" returned: 0 in 0.712s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:06 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a 1G
Nov 14 03:35:06 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:07 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a 1G" returned: 0 in 0.554s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21104413-8ee9-46d9-bb71-b4d00422303b -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:07 devstack sudo[97993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21104413-8ee9-46d9-bb71-b4d00422303b -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a
Nov 14 03:35:07 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:08 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21104413-8ee9-46d9-bb71-b4d00422303b -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a" returned: 0 in 0.636s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:08 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:35:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:08 devstack sudo[97998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a
Nov 14 03:35:08 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:08 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a" returned: 0 in 0.693s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:08 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.info
Nov 14 03:35:08 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:09 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.info" returned: 0 in 0.723s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:09 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 14 03:35:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:09 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.info
Nov 14 03:35:09 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d22b660e-1db1-4eba-a3b5-c5970eb67919 req-0c4a802a-f454-48f5-a464-66b1d770d1a8 tempest-TestMinimumBasicScenario-260141506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:09 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.info" returned: 0 in 0.501s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.907s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d22b660e-1db1-4eba-a3b5-c5970eb67919 req-0c4a802a-f454-48f5-a464-66b1d770d1a8 tempest-TestMinimumBasicScenario-260141506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.365s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:10 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b834bf6-1810-4277-a708-a14ca02a3119]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d22b660e-1db1-4eba-a3b5-c5970eb67919 req-0c4a802a-f454-48f5-a464-66b1d770d1a8 tempest-TestMinimumBasicScenario-260141506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8f5233db-12a3-47ea-84ce-15ea0b17fa77 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 8c07c89c-786f-4daa-9741-448f83c543ff: created successfully
Nov 14 03:35:10 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9
Nov 14 03:35:10 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:10 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d22b660e-1db1-4eba-a3b5-c5970eb67919 req-0c4a802a-f454-48f5-a464-66b1d770d1a8 tempest-TestMinimumBasicScenario-260141506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9" returned: 0 in 0.713s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d22b660e-1db1-4eba-a3b5-c5970eb67919 req-0c4a802a-f454-48f5-a464-66b1d770d1a8 tempest-TestMinimumBasicScenario-260141506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.730s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-d22b660e-1db1-4eba-a3b5-c5970eb67919 req-0c4a802a-f454-48f5-a464-66b1d770d1a8 tempest-TestMinimumBasicScenario-260141506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-4f8e8528-e19f-4910-883f-050115ef30d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd094fa1-1545-4108-8403-f3ef03521a65', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:35:10 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-d22b660e-1db1-4eba-a3b5-c5970eb67919 req-0c4a802a-f454-48f5-a464-66b1d770d1a8 tempest-TestMinimumBasicScenario-260141506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-d22b660e-1db1-4eba-a3b5-c5970eb67919 req-0c4a802a-f454-48f5-a464-66b1d770d1a8 tempest-TestMinimumBasicScenario-260141506 None] attachment_update completed successfully.
Nov 14 03:35:11 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 8c07c89c-786f-4daa-9741-448f83c543ff: deleting
Nov 14 03:35:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 8c07c89c-786f-4daa-9741-448f83c543ff: deleting {{(pid=80846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-21104413-8ee9-46d9-bb71-b4d00422303b" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-21104413-8ee9-46d9-bb71-b4d00422303b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-4ca5af8d-d5fa-4442-ae03-ccc153337b8a" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-4ca5af8d-d5fa-4442-ae03-ccc153337b8a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Deleting offline snapshot 4ca5af8d-d5fa-4442-ae03-ccc153337b8a of volume 21104413-8ee9-46d9-bb71-b4d00422303b {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] snapshot_file for this snap is: volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[525740c6-38b1-4473-8271-fa033f4b3934]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:11 devstack sudo[98088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a
Nov 14 03:35:11 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:12 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a" returned: 0 in 0.748s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21104413-8ee9-46d9-bb71-b4d00422303b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:35:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94abf07-12dc-480d-bd67-a82bf191b0a7]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:12 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b
Nov 14 03:35:12 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:12 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b" returned: 0 in 0.714s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:12 devstack sudo[98421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a
Nov 14 03:35:12 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:13 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a" returned: 0 in 0.584s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:13 devstack sudo[98426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a
Nov 14 03:35:13 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:14 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b.4ca5af8d-d5fa-4442-ae03-ccc153337b8a" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-4ca5af8d-d5fa-4442-ae03-ccc153337b8a" released by "_delete_snapshot" :: held 2.681s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-21104413-8ee9-46d9-bb71-b4d00422303b" released by "delete_snapshot" :: held 2.698s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:14 devstack cinder-volume[80846]: WARNING cinder.quota [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1865798881 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1865798881, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:35:14 devstack cinder-volume[80846]: WARNING cinder.quota [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1865798881 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1865798881, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:35:14 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['174c8907-0c4b-4bf5-9720-85284ee62433', '48a0bfe6-6d8e-41b8-9e11-9e1bcf381b79', 'e53266bc-ea47-4d41-967d-0679be5c867d', '000a35f3-2d89-4c30-828c-a17badf86570'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e3974b9a-39da-4f68-b5b0-a780d5f95017 tempest-GroupSnapshotsTest-1448337580 None] group_snapshot 8c07c89c-786f-4daa-9741-448f83c543ff: deleted successfully
Nov 14 03:35:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "cinder-quobyte-21104413-8ee9-46d9-bb71-b4d00422303b" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-21104413-8ee9-46d9-bb71-b4d00422303b" acquired by "delete_volume" :: waited 0.026s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9b17bb-1f88-47f4-83ae-5ca1837b7b61]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:15 devstack sudo[98429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b
Nov 14 03:35:15 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:15 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b" returned: 0 in 0.794s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:15 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b
Nov 14 03:35:15 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:16 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-21104413-8ee9-46d9-bb71-b4d00422303b" returned: 0 in 0.592s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Lock "cinder-quobyte-21104413-8ee9-46d9-bb71-b4d00422303b" released by "delete_volume" :: held 1.432s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['aa22be22-0546-40ed-8e9f-e794052f3cb2'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:16 devstack cinder-volume[80846]: WARNING cinder.quota [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1865798881 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1865798881, it is now deprecated. Please use the default quota class for default quota.
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Created reservations ['78a4f9e4-c5b8-4b42-8ea2-e8dd264c4c03', 'de487f2e-83a3-4a4c-be1c-8668dbe97956', '1ddb0e6c-116c-4404-a5c1-194194b4eaca', 'a13b315e-bbac-4a5d-84e7-b481523c47d9'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:16 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:35:16 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:17 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.818s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:17 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:35:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-71de87b8-95d3-4f6a-8b1b-2ed083c96f38 tempest-GroupSnapshotsTest-1448337580 None] Delete group completed successfully.
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=115,cinder:UPDATE=110,cinder:DELETE=3,cinder:INSERT=35 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:35:23 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Flow 'volume_create_manager' (53b621f5-4ea5-4c7d-af19-b3d1143e0d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1d208f-7d29-4ea2-9b5b-7b5d3984f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1d208f-7d29-4ea2-9b5b-7b5d3984f41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1470376564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5fb714-4661-4687-956d-842bfa100bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a682dd1f42364b768b8500d6fe162af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:23Z,use_quota=True,user_id='1e0c83506b35409a8f5b00ba64b4693c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04191b77-e01e-4774-a768-946c6c09d918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04191b77-e01e-4774-a768-946c6c09d918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a5526c-a206-4a5e-9227-47531ad90e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a5526c-a206-4a5e-9227-47531ad90e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5fb714-4661-4687-956d-842bfa100bba', 'volume_name': 'volume-7e5fb714-4661-4687-956d-842bfa100bba', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baaa7fac-07e4-4f95-aff6-d0d49bf8f3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baaa7fac-07e4-4f95-aff6-d0d49bf8f3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0636e4-12e2-4880-994b-088f0f09e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:23 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Volume 7e5fb714-4661-4687-956d-842bfa100bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5fb714-4661-4687-956d-842bfa100bba', 'volume_size': 1}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1470376564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5fb714-4661-4687-956d-842bfa100bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a682dd1f42364b768b8500d6fe162af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:23Z,use_quota=True,user_id='1e0c83506b35409a8f5b00ba64b4693c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Creating volume 7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:35:23 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:35:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:23 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba 1073741824
Nov 14 03:35:23 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:24 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba 1073741824" returned: 0 in 0.783s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:24 devstack sudo[98500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba
Nov 14 03:35:24 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:24 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba" returned: 0 in 0.636s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0636e4-12e2-4880-994b-088f0f09e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5fb714-4661-4687-956d-842bfa100bba', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05469df-e4e8-406e-997b-ac9030c03df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:24 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Volume volume-7e5fb714-4661-4687-956d-842bfa100bba (7e5fb714-4661-4687-956d-842bfa100bba): created successfully
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05469df-e4e8-406e-997b-ac9030c03df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Flow 'volume_create_manager' (53b621f5-4ea5-4c7d-af19-b3d1143e0d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:24 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e2fca666-a3e5-4d56-85c6-b3a1ff688b91 tempest-TestStampPattern-286744405 None] Created volume successfully.
Nov 14 03:35:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Flow 'volume_create_manager' (2164cd1a-8403-4ee5-95e9-878139ecd282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7945cff5-459c-4fe3-bd2f-09d104fbbfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7945cff5-459c-4fe3-bd2f-09d104fbbfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1929269895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba04606-f41d-415e-80a2-485a7504772c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e927dc6f5324916a0ab4f09350179d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:26Z,use_quota=True,user_id='486115e93e6d41c79750364c5918f86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99baa390-cbef-49c1-a25b-b5ac592290d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99baa390-cbef-49c1-a25b-b5ac592290d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56113c1-3543-46b5-90f4-68e2555e381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56113c1-3543-46b5-90f4-68e2555e381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba04606-f41d-415e-80a2-485a7504772c', 'volume_name': 'volume-4ba04606-f41d-415e-80a2-485a7504772c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd44e5a4-52ab-4c82-afb5-9db8beeff0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd44e5a4-52ab-4c82-afb5-9db8beeff0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd1fe26-4eeb-4947-aab7-151288caee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:26 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Volume 4ba04606-f41d-415e-80a2-485a7504772c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba04606-f41d-415e-80a2-485a7504772c', 'volume_size': 1}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1929269895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba04606-f41d-415e-80a2-485a7504772c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e927dc6f5324916a0ab4f09350179d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:26Z,use_quota=True,user_id='486115e93e6d41c79750364c5918f86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Creating volume 4ba04606-f41d-415e-80a2-485a7504772c {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:35:26 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:26 devstack sudo[98511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c 1073741824
Nov 14 03:35:26 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:26 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c 1073741824" returned: 0 in 0.580s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:26 devstack sudo[98516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c
Nov 14 03:35:26 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:27 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c" returned: 0 in 0.419s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:35:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd1fe26-4eeb-4947-aab7-151288caee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba04606-f41d-415e-80a2-485a7504772c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac632b5-c544-4b57-9ce0-fb43bf6dfaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:27 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Volume volume-4ba04606-f41d-415e-80a2-485a7504772c (4ba04606-f41d-415e-80a2-485a7504772c): created successfully
Nov 14 03:35:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac632b5-c544-4b57-9ce0-fb43bf6dfaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Flow 'volume_create_manager' (2164cd1a-8403-4ee5-95e9-878139ecd282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b31a8ade-6550-420a-ac07-f875319f4ee3 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Created volume successfully.
Nov 14 03:35:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Acquiring lock "cinder-4ba04606-f41d-415e-80a2-485a7504772c-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "cinder-4ba04606-f41d-415e-80a2-485a7504772c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:29 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Acquiring lock "cinder-quobyte-4ba04606-f41d-415e-80a2-485a7504772c" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "cinder-quobyte-4ba04606-f41d-415e-80a2-485a7504772c" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:29 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2534e9-1e02-4a27-a59c-ec2fb1804da6]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:29 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c
Nov 14 03:35:29 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:29 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c" returned: 0 in 0.730s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:29 devstack sudo[98524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c
Nov 14 03:35:29 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:30 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4ba04606-f41d-415e-80a2-485a7504772c" returned: 0 in 0.580s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "cinder-quobyte-4ba04606-f41d-415e-80a2-485a7504772c" released by "delete_volume" :: held 1.353s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=113,cinder:INSERT=17,cinder:UPDATE=120,cinder:DELETE=6 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Created reservations ['66390adf-1bca-4f46-b139-456eb52d6c6c', '5a5fc790-5e06-4790-bf33-029b75ea88fa', '55ec5863-13c4-4fb3-9f8e-6dbfa4378358', '6ac5f88f-8978-4e5f-9421-005bdaa7452d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:30 devstack sudo[98529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:35:30 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:31 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.523s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:31 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:35:31 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Deleted volume successfully.
Nov 14 03:35:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f5edb233-ef23-45c6-837a-83f7da619740 tempest-VolumeQuotasNegativeTestJSON-1132094453 None] Lock "cinder-4ba04606-f41d-415e-80a2-485a7504772c-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:34 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Flow 'volume_create_manager' (c0347035-c0d2-4f32-8668-bf5804b6683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11dc4556-099b-4a3e-86db-a221d9c8efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11dc4556-099b-4a3e-86db-a221d9c8efbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1454010473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ccf854-8aef-41ae-8042-c1febc60f3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3beeb30e8dc40b7a7bba126addd9fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:35Z,use_quota=True,user_id='9c480c45739a485d94b9eacdda404125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fe2c62-6da9-460a-9585-d4f4a2d22035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fe2c62-6da9-460a-9585-d4f4a2d22035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea301ab-ea49-41c0-aea3-c545074df7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea301ab-ea49-41c0-aea3-c545074df7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ccf854-8aef-41ae-8042-c1febc60f3fe', 'volume_name': 'volume-96ccf854-8aef-41ae-8042-c1febc60f3fe', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9005fd04-7a34-42ec-a951-234711743f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9005fd04-7a34-42ec-a951-234711743f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd52f09-6d6f-4fe0-ba19-4509ec6a7d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:34 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Volume 96ccf854-8aef-41ae-8042-c1febc60f3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ccf854-8aef-41ae-8042-c1febc60f3fe', 'volume_size': 1}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1454010473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ccf854-8aef-41ae-8042-c1febc60f3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3beeb30e8dc40b7a7bba126addd9fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:35Z,use_quota=True,user_id='9c480c45739a485d94b9eacdda404125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Creating volume 96ccf854-8aef-41ae-8042-c1febc60f3fe {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:35:34 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:35:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:34 devstack sudo[98574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe 1073741824
Nov 14 03:35:34 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:35 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe 1073741824" returned: 0 in 0.858s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:35 devstack sudo[98630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe
Nov 14 03:35:35 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:36 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe" returned: 0 in 0.574s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd52f09-6d6f-4fe0-ba19-4509ec6a7d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ccf854-8aef-41ae-8042-c1febc60f3fe', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10b2ac7-49aa-4bd2-9c13-f32d171fd9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:36 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Volume volume-96ccf854-8aef-41ae-8042-c1febc60f3fe (96ccf854-8aef-41ae-8042-c1febc60f3fe): created successfully
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10b2ac7-49aa-4bd2-9c13-f32d171fd9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Flow 'volume_create_manager' (c0347035-c0d2-4f32-8668-bf5804b6683f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:36 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c74972d4-6e0e-4538-a3a8-b67c63e42fdc tempest-VolumesServicesTestJSON-1281648538 None] Created volume successfully.
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Acquiring lock "cinder-96ccf854-8aef-41ae-8042-c1febc60f3fe-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Lock "cinder-96ccf854-8aef-41ae-8042-c1febc60f3fe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:36 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Acquiring lock "cinder-quobyte-96ccf854-8aef-41ae-8042-c1febc60f3fe" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Lock "cinder-quobyte-96ccf854-8aef-41ae-8042-c1febc60f3fe" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:37 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb3e570-4be5-4c62-890d-2b8dfbdf36fa]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:37 devstack sudo[98642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe
Nov 14 03:35:37 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:37 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe" returned: 0 in 0.617s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:37 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe
Nov 14 03:35:37 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:38 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-96ccf854-8aef-41ae-8042-c1febc60f3fe" returned: 0 in 0.526s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Lock "cinder-quobyte-96ccf854-8aef-41ae-8042-c1febc60f3fe" released by "delete_volume" :: held 1.180s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Created reservations ['9fed235e-7579-4b76-96fd-ef83f21b02d8', 'f674c653-7271-4002-8739-42c99788a13a', 'af60617b-6c16-4657-a44d-e561d0d302ff', 'edae5478-4171-4f28-ac66-62ecf98db3f5'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:38 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:35:38 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:38 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.445s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:35:38 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Deleted volume successfully.
Nov 14 03:35:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-44725aaa-47f8-40a1-872c-a3915fe60a70 tempest-VolumesServicesTestJSON-1281648538 None] Lock "cinder-96ccf854-8aef-41ae-8042-c1febc60f3fe-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:42 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Flow 'volume_create_manager' (552d16e6-f5b6-4400-bb10-62e77ccc14c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1523b41-ce85-43eb-88d4-3c67a633b57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1523b41-ce85-43eb-88d4-3c67a633b57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1178771013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db124e3-251b-4dc4-879a-8f1184df914f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a8c03e1acd40c7ad7090afc61087ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:42Z,use_quota=True,user_id='b51ddc9502fd4ea4ba32d649998c2ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f8d8f4-cb9a-4341-b222-3b7299acb7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f8d8f4-cb9a-4341-b222-3b7299acb7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f061fe2c-f57d-45ee-be3b-5877d9f00382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f061fe2c-f57d-45ee-be3b-5877d9f00382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db124e3-251b-4dc4-879a-8f1184df914f', 'volume_name': 'volume-0db124e3-251b-4dc4-879a-8f1184df914f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3049e309-d0a6-43b1-b5e5-2689b53c1038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3049e309-d0a6-43b1-b5e5-2689b53c1038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8a2966-8521-472e-8aa7-5a192316b86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:42 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Volume 0db124e3-251b-4dc4-879a-8f1184df914f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db124e3-251b-4dc4-879a-8f1184df914f', 'volume_size': 1}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1178771013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db124e3-251b-4dc4-879a-8f1184df914f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a8c03e1acd40c7ad7090afc61087ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:35:42Z,use_quota=True,user_id='b51ddc9502fd4ea4ba32d649998c2ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Creating volume 0db124e3-251b-4dc4-879a-8f1184df914f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:35:42 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:35:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:42 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f 1073741824
Nov 14 03:35:42 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:43 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f 1073741824" returned: 0 in 0.567s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:43 devstack sudo[98664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f
Nov 14 03:35:43 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:43 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f" returned: 0 in 0.492s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8a2966-8521-472e-8aa7-5a192316b86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db124e3-251b-4dc4-879a-8f1184df914f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953c6a21-a30c-4146-b145-218c6e8aefd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:35:43 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Volume volume-0db124e3-251b-4dc4-879a-8f1184df914f (0db124e3-251b-4dc4-879a-8f1184df914f): created successfully
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953c6a21-a30c-4146-b145-218c6e8aefd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:35:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Flow 'volume_create_manager' (552d16e6-f5b6-4400-bb10-62e77ccc14c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:35:43 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-84099112-3124-45bc-8e3e-397ef8839e45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Created volume successfully.
Nov 14 03:35:44 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Creating offline snapshot 0ee903c5-8964-4764-9984-0e2a8a05e453 of volume 0db124e3-251b-4dc4-879a-8f1184df914f {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:35:44 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6827fe2-17c1-4979-b255-c4707b3ee8ff]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:44 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f
Nov 14 03:35:44 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:45 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f" returned: 0 in 0.554s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:45 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 1G
Nov 14 03:35:45 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:45 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 1G" returned: 0 in 0.563s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db124e3-251b-4dc4-879a-8f1184df914f -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:45 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db124e3-251b-4dc4-879a-8f1184df914f -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453
Nov 14 03:35:45 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:46 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db124e3-251b-4dc4-879a-8f1184df914f -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453" returned: 0 in 0.476s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:46 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 is being set with open permissions: ugo+rw
Nov 14 03:35:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:46 devstack sudo[98698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453
Nov 14 03:35:46 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:46 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453" returned: 0 in 0.439s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:46 devstack sudo[98701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.info
Nov 14 03:35:46 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:47 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.info" returned: 0 in 0.447s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:47 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.info is being set with open permissions: ugo+rw
Nov 14 03:35:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:47 devstack sudo[98704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.info
Nov 14 03:35:47 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:47 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.info" returned: 0 in 0.438s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.975s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-435aba72-bfc2-4ef9-9fa5-da23abf53beb tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Create snapshot completed successfully
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "cinder-0ee903c5-8964-4764-9984-0e2a8a05e453-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-0ee903c5-8964-4764-9984-0e2a8a05e453-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "cinder-quobyte-0db124e3-251b-4dc4-879a-8f1184df914f" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-quobyte-0db124e3-251b-4dc4-879a-8f1184df914f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "cinder-quobyte-0ee903c5-8964-4764-9984-0e2a8a05e453" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-quobyte-0ee903c5-8964-4764-9984-0e2a8a05e453" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Deleting offline snapshot 0ee903c5-8964-4764-9984-0e2a8a05e453 of volume 0db124e3-251b-4dc4-879a-8f1184df914f {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] snapshot_file for this snap is: volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d020bc9-219e-46ff-acb9-2df7f69fcef0]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:48 devstack sudo[98707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453
Nov 14 03:35:48 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:48 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453" returned: 0 in 0.566s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0db124e3-251b-4dc4-879a-8f1184df914f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a1dceb-4f60-4bd5-9cdb-e7a5804275d1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:48 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f
Nov 14 03:35:48 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:49 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f" returned: 0 in 0.577s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:49 devstack sudo[98717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453
Nov 14 03:35:49 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:49 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453" returned: 0 in 0.485s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:49 devstack sudo[98722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453
Nov 14 03:35:49 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:50 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f.0ee903c5-8964-4764-9984-0e2a8a05e453" returned: 0 in 0.445s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-quobyte-0ee903c5-8964-4764-9984-0e2a8a05e453" released by "_delete_snapshot" :: held 2.169s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-quobyte-0db124e3-251b-4dc4-879a-8f1184df914f" released by "delete_snapshot" :: held 2.184s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:50 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Created reservations ['4e01aed9-cbc3-4544-891e-673f425b23b2', '424b7c42-92eb-4a0b-9d00-0238660cf68f', '0e7ccd16-2ff1-45b1-8724-88b138718753', '50b39b78-847e-49a2-a4a9-5314a48acaa7'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:50 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Delete snapshot completed successfully.
Nov 14 03:35:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e17a5c05-7f27-45b7-87c1-f41fba38a30a tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-0ee903c5-8964-4764-9984-0e2a8a05e453-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "cinder-0db124e3-251b-4dc4-879a-8f1184df914f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-0db124e3-251b-4dc4-879a-8f1184df914f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:51 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:35:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "cinder-quobyte-0db124e3-251b-4dc4-879a-8f1184df914f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:35:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-quobyte-0db124e3-251b-4dc4-879a-8f1184df914f" acquired by "delete_volume" :: waited 0.022s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:35:51 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2573cdd-6ac7-4fd7-a8ab-ad040e58283f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:35:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:51 devstack sudo[98726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f
Nov 14 03:35:51 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:51 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f" returned: 0 in 0.558s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:51 devstack sudo[98731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f
Nov 14 03:35:51 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:52 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0db124e3-251b-4dc4-879a-8f1184df914f" returned: 0 in 0.476s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-quobyte-0db124e3-251b-4dc4-879a-8f1184df914f" released by "delete_volume" :: held 1.084s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Created reservations ['bd3df26d-f0ce-4fc6-99a9-8a8f2059a1c3', '16a85365-c3e1-4d84-8708-7f9dccec8c14', '4b2e4e61-b835-4766-99a3-e33b702b90c1', '34635b58-a3e3-47ed-8e0b-a8a3be90b95d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:52 devstack sudo[98734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:35:52 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:52 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.452s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:35:52 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Deleted volume successfully.
Nov 14 03:35:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-4fef7226-4925-429c-b898-d3cfc6791ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1199834275 None] Lock "cinder-0db124e3-251b-4dc4-879a-8f1184df914f-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:35:54 devstack sudo[98738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:35:54 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:35:54 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.638s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:35:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:00 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Flow 'volume_create_manager' (0b50fab3-dfc8-433b-8204-8057bd32517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b6d860-7695-430e-87b5-82f00d9b7cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b6d860-7695-430e-87b5-82f00d9b7cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1646973507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f87906-bbe1-497e-903d-99aa3d79a997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eca8f900584f41b65beed59649c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:00Z,use_quota=True,user_id='fcb956effcfe4327908fed66f1af6f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa69b22-75b3-426c-ab5d-1fa988a9b04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa69b22-75b3-426c-ab5d-1fa988a9b04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d6806e-c769-4c06-bc64-cc76b838d5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d6806e-c769-4c06-bc64-cc76b838d5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f87906-bbe1-497e-903d-99aa3d79a997', 'volume_name': 'volume-86f87906-bbe1-497e-903d-99aa3d79a997', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4f0fbb-70c0-4c1f-9867-7759e82f4d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4f0fbb-70c0-4c1f-9867-7759e82f4d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd253c7-60e8-4117-be84-ec8b2f94125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:00 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Volume 86f87906-bbe1-497e-903d-99aa3d79a997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f87906-bbe1-497e-903d-99aa3d79a997', 'volume_size': 1}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1646973507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f87906-bbe1-497e-903d-99aa3d79a997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eca8f900584f41b65beed59649c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:00Z,use_quota=True,user_id='fcb956effcfe4327908fed66f1af6f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Creating volume 86f87906-bbe1-497e-903d-99aa3d79a997 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:36:00 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:00 devstack sudo[98756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997 1073741824
Nov 14 03:36:00 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:00 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997 1073741824" returned: 0 in 0.567s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:00 devstack sudo[98762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997
Nov 14 03:36:00 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:01 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997" returned: 0 in 0.469s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:36:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd253c7-60e8-4117-be84-ec8b2f94125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f87906-bbe1-497e-903d-99aa3d79a997', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1920a02-f59f-4d75-a671-ba6f2e77f523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:01 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Volume volume-86f87906-bbe1-497e-903d-99aa3d79a997 (86f87906-bbe1-497e-903d-99aa3d79a997): created successfully
Nov 14 03:36:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1920a02-f59f-4d75-a671-ba6f2e77f523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Flow 'volume_create_manager' (0b50fab3-dfc8-433b-8204-8057bd32517c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5e9980ce-580a-4a71-a778-a2ca56b767f0 tempest-VolumesListAdminTestJSON-1752182218 None] Created volume successfully.
Nov 14 03:36:02 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Flow 'volume_create_manager' (6db71359-bb8a-45c8-b35a-34116fc71dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ff8175-8f33-4031-af4d-e6260ad7f56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ff8175-8f33-4031-af4d-e6260ad7f56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-287669170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0d6c32-29bc-4e6d-b257-b246f0bdd9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eca8f900584f41b65beed59649c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:03Z,use_quota=True,user_id='fcb956effcfe4327908fed66f1af6f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df3eac7-de4f-476b-bada-3233168ccec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df3eac7-de4f-476b-bada-3233168ccec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e78462-ea04-4b32-811c-04cfae28719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e78462-ea04-4b32-811c-04cfae28719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0d6c32-29bc-4e6d-b257-b246f0bdd9db', 'volume_name': 'volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afda9ae4-aede-4a84-b85c-fdd8001ec8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afda9ae4-aede-4a84-b85c-fdd8001ec8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddfbf2a-e705-4818-a086-540cab6669e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:02 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Volume aa0d6c32-29bc-4e6d-b257-b246f0bdd9db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db', 'volume_size': 1}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-287669170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0d6c32-29bc-4e6d-b257-b246f0bdd9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eca8f900584f41b65beed59649c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:03Z,use_quota=True,user_id='fcb956effcfe4327908fed66f1af6f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Creating volume aa0d6c32-29bc-4e6d-b257-b246f0bdd9db {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:36:02 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:36:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:02 devstack sudo[98765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db 1073741824
Nov 14 03:36:02 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:03 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db 1073741824" returned: 0 in 0.605s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:03 devstack sudo[98770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db
Nov 14 03:36:03 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:03 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db" returned: 0 in 0.643s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddfbf2a-e705-4818-a086-540cab6669e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50972925-0219-41de-8ec2-83a29a0a3986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:03 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Volume volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db (aa0d6c32-29bc-4e6d-b257-b246f0bdd9db): created successfully
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50972925-0219-41de-8ec2-83a29a0a3986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Flow 'volume_create_manager' (6db71359-bb8a-45c8-b35a-34116fc71dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9572a611-8303-48b2-a030-01b064b01f00 tempest-VolumesListAdminTestJSON-1752182218 None] Created volume successfully.
Nov 14 03:36:05 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Flow 'volume_create_manager' (6071a8de-e072-4507-964a-15944794d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f170e87-694e-4069-899c-6750ec2be89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f170e87-694e-4069-899c-6750ec2be89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1718458663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d7cd96-0b64-4da7-80a7-b3f6da82406f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eca8f900584f41b65beed59649c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:05Z,use_quota=True,user_id='fcb956effcfe4327908fed66f1af6f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32709685-2156-45cc-aab6-c8f581a3ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32709685-2156-45cc-aab6-c8f581a3ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8da90cc-333d-490b-84a5-71ae4fc081c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8da90cc-333d-490b-84a5-71ae4fc081c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d7cd96-0b64-4da7-80a7-b3f6da82406f', 'volume_name': 'volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2725521-06d1-43fb-9cb8-a8e4471e83b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2725521-06d1-43fb-9cb8-a8e4471e83b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3088c64-3c7b-485d-869c-5881c45d26e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:05 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Volume 16d7cd96-0b64-4da7-80a7-b3f6da82406f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f', 'volume_size': 1}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1718458663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d7cd96-0b64-4da7-80a7-b3f6da82406f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eca8f900584f41b65beed59649c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:05Z,use_quota=True,user_id='fcb956effcfe4327908fed66f1af6f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Creating volume 16d7cd96-0b64-4da7-80a7-b3f6da82406f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:36:05 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:05 devstack sudo[98865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f 1073741824
Nov 14 03:36:05 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:05 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f 1073741824" returned: 0 in 0.586s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:05 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f
Nov 14 03:36:05 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:06 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f" returned: 0 in 0.457s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:36:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3088c64-3c7b-485d-869c-5881c45d26e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d67c23-b171-4c9a-83d2-dc6673336486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:06 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Volume volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f (16d7cd96-0b64-4da7-80a7-b3f6da82406f): created successfully
Nov 14 03:36:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d67c23-b171-4c9a-83d2-dc6673336486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Flow 'volume_create_manager' (6071a8de-e072-4507-964a-15944794d20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-58b4b804-19ec-43b5-953e-5ee484e46331 tempest-VolumesListAdminTestJSON-1752182218 None] Created volume successfully.
Nov 14 03:36:07 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Flow 'volume_create_manager' (e3056965-be0f-474a-8939-c386431175db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60a788c-2fd8-48de-b5ab-bb4cee23dc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60a788c-2fd8-48de-b5ab-bb4cee23dc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5f5d1-cbe7-4d63-8964-195c0cd5bc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9281697fdf04eb18208d1a42b3c9575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:07Z,use_quota=True,user_id='3cdfebd22123430299a54fdf5a64a14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f697ce6-c4f1-47af-9463-a27571200657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f697ce6-c4f1-47af-9463-a27571200657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c54579-77a8-441a-bbcf-b628947aa984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c54579-77a8-441a-bbcf-b628947aa984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c5f5d1-cbe7-4d63-8964-195c0cd5bc39', 'volume_name': 'volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf44de6-78ca-4df2-9a60-3e70e66a21ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf44de6-78ca-4df2-9a60-3e70e66a21ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47ef920-73e0-4b98-8833-a1c1dd626599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:07 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Volume 40c5f5d1-cbe7-4d63-8964-195c0cd5bc39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39', 'volume_size': 1}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5f5d1-cbe7-4d63-8964-195c0cd5bc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9281697fdf04eb18208d1a42b3c9575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:07Z,use_quota=True,user_id='3cdfebd22123430299a54fdf5a64a14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Creating volume 40c5f5d1-cbe7-4d63-8964-195c0cd5bc39 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:36:07 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:36:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:07 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39 1073741824
Nov 14 03:36:07 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:08 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39 1073741824" returned: 0 in 0.541s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:08 devstack sudo[98879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39
Nov 14 03:36:08 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:08 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39" returned: 0 in 0.454s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47ef920-73e0-4b98-8833-a1c1dd626599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd4e2fc-cf93-4232-9157-630dd94e362b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:08 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Volume volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39 (40c5f5d1-cbe7-4d63-8964-195c0cd5bc39): created successfully
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd4e2fc-cf93-4232-9157-630dd94e362b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Flow 'volume_create_manager' (e3056965-be0f-474a-8939-c386431175db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:08 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-01384eec-b623-45ee-a688-cb83babddaeb tempest-VolumesListAdminTestJSON-1393267792 None] Created volume successfully.
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Acquiring lock "cinder-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Lock "cinder-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:09 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Acquiring lock "cinder-quobyte-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Lock "cinder-quobyte-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6367c08-6eef-4364-b1f6-3287620725a1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "cinder-16d7cd96-0b64-4da7-80a7-b3f6da82406f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-16d7cd96-0b64-4da7-80a7-b3f6da82406f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:09 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "cinder-quobyte-16d7cd96-0b64-4da7-80a7-b3f6da82406f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-quobyte-16d7cd96-0b64-4da7-80a7-b3f6da82406f" acquired by "delete_volume" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2907e7-9813-45a2-b580-e6b21de1ff9c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:09 devstack sudo[98882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39
Nov 14 03:36:09 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:10 devstack sudo[98883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f
Nov 14 03:36:10 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:10 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39" returned: 0 in 0.641s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:10 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39
Nov 14 03:36:10 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:10 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f" returned: 0 in 0.587s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:10 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f
Nov 14 03:36:10 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:10 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39" returned: 0 in 0.515s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Lock "cinder-quobyte-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39" released by "delete_volume" :: held 1.200s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Created reservations ['ef4108b6-2b73-4afe-b4c7-9ca6880dcfd7', '1cc8cc1e-5394-4b69-b2be-16efa6dcb49e', '06a270c8-b636-422b-9970-02c9e0de2c35', 'f5482fef-0bb1-4b00-85f3-8958069e3734'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:36:11 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-16d7cd96-0b64-4da7-80a7-b3f6da82406f" returned: 0 in 0.541s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-quobyte-16d7cd96-0b64-4da7-80a7-b3f6da82406f" released by "delete_volume" :: held 1.155s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:11 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:11 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Created reservations ['d9493f61-8673-4952-91a0-c601ceffdb06', '9fe04c38-d1be-48e0-b66f-6b8bcffa0c96', '8189c4c3-ea31-4e57-9c36-8cc1c4a9b4ff', '5a2cb55a-66bc-4954-b090-69a9945349fb'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:11 devstack sudo[98901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:11 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:11 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.492s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:11 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Deleted volume successfully.
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-284672d2-0afd-421b-a953-f84cf3814ca8 tempest-VolumesListAdminTestJSON-1393267792 None] Lock "cinder-40c5f5d1-cbe7-4d63-8964-195c0cd5bc39-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:11 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.454s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:11 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Deleted volume successfully.
Nov 14 03:36:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9bdca777-666a-4a43-a677-a1cdff9abf14 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-16d7cd96-0b64-4da7-80a7-b3f6da82406f-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "cinder-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "cinder-quobyte-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-quobyte-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f192adc6-9efa-47d0-9e2e-51567748a593]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:12 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db
Nov 14 03:36:12 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:12 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db" returned: 0 in 0.665s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:12 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db
Nov 14 03:36:12 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:13 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db" returned: 0 in 0.459s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-quobyte-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db" released by "delete_volume" :: held 1.168s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Created reservations ['a11ccc77-353a-4447-a65f-96768c685489', 'c7dee023-7962-4475-91ab-f7f764216b14', 'f2e43579-0d9f-4b64-84fb-7446063faed6', '8cf89d91-c1b9-4f1b-bf5e-1428a02dca0e'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:13 devstack sudo[98926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:13 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:13 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.427s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Deleted volume successfully.
Nov 14 03:36:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-86d3d196-1190-457d-946e-a99fa6ccbf90 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-aa0d6c32-29bc-4e6d-b257-b246f0bdd9db-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "cinder-86f87906-bbe1-497e-903d-99aa3d79a997-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-86f87906-bbe1-497e-903d-99aa3d79a997-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "cinder-quobyte-86f87906-bbe1-497e-903d-99aa3d79a997" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-quobyte-86f87906-bbe1-497e-903d-99aa3d79a997" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[74688bff-f7e9-43c9-b668-76ce40b75c66]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:14 devstack sudo[98929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997
Nov 14 03:36:14 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:14 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997" returned: 0 in 0.532s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:14 devstack sudo[98934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997
Nov 14 03:36:14 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:15 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-86f87906-bbe1-497e-903d-99aa3d79a997" returned: 0 in 0.438s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-quobyte-86f87906-bbe1-497e-903d-99aa3d79a997" released by "delete_volume" :: held 1.001s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Created reservations ['ad8af96c-ddb3-4821-95c4-460a95dffedb', '48049af4-1aec-4336-a849-9a6e00538a0f', 'efaebcf7-2464-47e6-a13a-a152f7e92fef', '4ffdcdfd-2bb9-4300-a55e-c13a0fcb61a8'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:15 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:15 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:15 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.441s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:15 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Deleted volume successfully.
Nov 14 03:36:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8eb2e830-87b6-4d38-b9af-126e4bb29eb9 tempest-VolumesListAdminTestJSON-1752182218 None] Lock "cinder-86f87906-bbe1-497e-903d-99aa3d79a997-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:19 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Flow 'volume_create_manager' (3409987a-170d-426d-8d2c-08dacac72947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29853b23-fdc5-4339-8b91-6b70c2b678be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29853b23-fdc5-4339-8b91-6b70c2b678be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1477920450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ce9708-1f7e-42ec-908d-df3002092c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aba79a673104d8aa52f9318b55148be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:19Z,use_quota=True,user_id='d54e9d7528304b1f9bf0fd7cb34a120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783b9586-7191-4348-a5bf-82c40bc0e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783b9586-7191-4348-a5bf-82c40bc0e468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da45c7b-898e-4c68-9156-0b5b9004d698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da45c7b-898e-4c68-9156-0b5b9004d698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8ce9708-1f7e-42ec-908d-df3002092c80', 'volume_name': 'volume-a8ce9708-1f7e-42ec-908d-df3002092c80', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26e2ba90>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40730db-7774-4d24-8b88-ba5a8a4fe97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40730db-7774-4d24-8b88-ba5a8a4fe97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482f6e4c-6516-4c8e-a5bd-eaed557d8a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Volume a8ce9708-1f7e-42ec-908d-df3002092c80: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8ce9708-1f7e-42ec-908d-df3002092c80', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26e2ba90>}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Cloning a8ce9708-1f7e-42ec-908d-df3002092c80 from image 505e4538-4930-46f5-ae28-a520ed743bcf  at location (None, None). {{(pid=80846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 14 03:36:19 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Image download 20.69 MB at 20.69 MB/s
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[398008c4-4aa8-4215-97a0-a4ac0ffbbcc8]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:19 devstack sudo[98955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD
Nov 14 03:36:19 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:19 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:19 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf is fetched for user d54e9d7528304b1f9bf0fd7cb34a120b. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e3d887-cd54-40e0-b328-eeb594e0125a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:20 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD
Nov 14 03:36:20 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:20 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD" returned: 0 in 0.545s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1477920450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ce9708-1f7e-42ec-908d-df3002092c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aba79a673104d8aa52f9318b55148be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:19Z,use_quota=True,user_id='d54e9d7528304b1f9bf0fd7cb34a120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Creating volume a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:36:20 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:36:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:20 devstack sudo[98967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 1073741824
Nov 14 03:36:20 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:21 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 1073741824" returned: 0 in 0.579s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:21 devstack sudo[98973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80
Nov 14 03:36:21 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:21 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80" returned: 0 in 0.432s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:36:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:21 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Attempting download of 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume a8ce9708-1f7e-42ec-908d-df3002092c80. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 14 03:36:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e914691-e500-408b-983f-45db0428e37d]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_530f88eh {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:21 devstack sudo[98976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_530f88eh
Nov 14 03:36:21 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:22 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_530f88eh" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_530f88eh {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:22 devstack sudo[98980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_530f88eh
Nov 14 03:36:22 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:22 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_530f88eh" returned: 1 in 0.514s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_505e4538-4930-46f5-ae28-a520ed743bcf_530f88eh' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:36:22 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48bd1cb-b941-4626-aebf-35eeb25d7e9a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:22 devstack sudo[98984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD
Nov 14 03:36:22 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:23 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:23 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] 505e4538-4930-46f5-ae28-a520ed743bcf was qcow2, converting to raw {{(pid=80846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 14 03:36:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:23 devstack sudo[98990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80
Nov 14 03:36:23 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:24 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80" returned: 0 in 1.075s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:24 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_505e4538-4930-46f5-ae28-a520ed743bcf_c_e11mhfdevstack@QuobyteHD, size 112.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:36:24 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Converted 112.00 MB image at 104.00 MB/s
Nov 14 03:36:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:24 devstack sudo[99042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 1G
Nov 14 03:36:24 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:24 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 1G" returned: 0 in 0.461s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:24 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6f19d8-a258-4237-8462-87383db6d92c]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:24 devstack sudo[99047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80
Nov 14 03:36:24 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:25 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:25 devstack sudo[99051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80
Nov 14 03:36:25 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:25 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80" returned: 1 in 0.552s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Downloaded image 505e4538-4930-46f5-ae28-a520ed743bcf ((None, None)) to volume a8ce9708-1f7e-42ec-908d-df3002092c80 successfully. {{(pid=80846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Temporary image 505e4538-4930-46f5-ae28-a520ed743bcf for user d54e9d7528304b1f9bf0fd7cb34a120b is deleted. {{(pid=80846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.volume.volume_utils [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Marking volume a8ce9708-1f7e-42ec-908d-df3002092c80 as bootable. {{(pid=80846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=72,cinder:SELECT=49,cinder:INSERT=18,cinder:DELETE=9 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Copying metadata from image 505e4538-4930-46f5-ae28-a520ed743bcf to a8ce9708-1f7e-42ec-908d-df3002092c80. {{(pid=80846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Creating volume glance metadata for volume a8ce9708-1f7e-42ec-908d-df3002092c80 backed by image 505e4538-4930-46f5-ae28-a520ed743bcf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482f6e4c-6516-4c8e-a5bd-eaed557d8a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ce9708-1f7e-42ec-908d-df3002092c80', 'volume_size': 1, 'image_id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b7a0deb212645b4a829181299820ac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '505e4538-4930-46f5-ae28-a520ed743bcf', 'created_at': datetime.datetime(2025, 11, 14, 2, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 14, 2, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/505e4538-4930-46f5-ae28-a520ed743bcf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fed26e2ba90>}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb334cb-f10d-4055-a28d-d1a8d36f1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:25 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Volume volume-a8ce9708-1f7e-42ec-908d-df3002092c80 (a8ce9708-1f7e-42ec-908d-df3002092c80): created successfully
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb334cb-f10d-4055-a28d-d1a8d36f1116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Flow 'volume_create_manager' (3409987a-170d-426d-8d2c-08dacac72947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:25 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0055f25c-81b2-4205-bf52-ecd3694ccf75 tempest-VolumesImageMetadata-570817659 None] Created volume successfully.
Nov 14 03:36:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Acquiring lock "cinder-a8ce9708-1f7e-42ec-908d-df3002092c80-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Lock "cinder-a8ce9708-1f7e-42ec-908d-df3002092c80-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Acquiring lock "cinder-quobyte-a8ce9708-1f7e-42ec-908d-df3002092c80" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Lock "cinder-quobyte-a8ce9708-1f7e-42ec-908d-df3002092c80" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:26 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454e205-f692-4b42-9f21-77d902f027fa]: (4, 'raw') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:26 devstack sudo[99067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80
Nov 14 03:36:26 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:27 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80" returned: 0 in 0.528s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:27 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80
Nov 14 03:36:27 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:27 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80" returned: 1 in 0.568s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80' failed. Not Retrying. {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 14 03:36:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:27 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80
Nov 14 03:36:27 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:28 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-a8ce9708-1f7e-42ec-908d-df3002092c80" returned: 0 in 0.435s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Lock "cinder-quobyte-a8ce9708-1f7e-42ec-908d-df3002092c80" released by "delete_volume" :: held 1.572s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Created reservations ['61a0445b-53a9-4c1c-8ba8-59726ef43250', 'cb531b70-5fa0-4229-92f9-fae123017151', 'e87f4867-96e9-4d1c-b5b6-432585cb4cb2', '1c5fab80-5ec5-471a-8fab-fe8b0d2c9624'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:28 devstack sudo[99079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:28 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:28 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.446s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:28 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Deleted volume successfully.
Nov 14 03:36:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67a81266-84f9-4578-a2c6-1d0702918b51 tempest-VolumesImageMetadata-570817659 None] Lock "cinder-a8ce9708-1f7e-42ec-908d-df3002092c80-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=96,cinder:SELECT=65,cinder:INSERT=23,cinder:DELETE=5 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:36:32 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Flow 'volume_create_manager' (1ddd6b52-e3c4-4a9e-a57f-7580bda1271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db31ed6-33b8-408e-a05a-764f60d41a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db31ed6-33b8-408e-a05a-764f60d41a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-683658593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2e2b96-b996-4143-92e7-5582aaef8308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c8fd7434a945b89bcf2c5ffa6aa03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:33Z,use_quota=True,user_id='4935ce97dc994501963adc5ec5874441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca30c940-75e8-465f-b1f3-cb96723d0326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca30c940-75e8-465f-b1f3-cb96723d0326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a879dc6-80ac-4004-bbc3-0e98e365a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a879dc6-80ac-4004-bbc3-0e98e365a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2e2b96-b996-4143-92e7-5582aaef8308', 'volume_name': 'volume-bf2e2b96-b996-4143-92e7-5582aaef8308', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7586c0-27e2-4f35-86c5-602a117f7879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7586c0-27e2-4f35-86c5-602a117f7879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f71d44e-fd28-4699-99ea-051ae713233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:32 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Volume bf2e2b96-b996-4143-92e7-5582aaef8308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2e2b96-b996-4143-92e7-5582aaef8308', 'volume_size': 1}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-683658593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2e2b96-b996-4143-92e7-5582aaef8308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c8fd7434a945b89bcf2c5ffa6aa03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:33Z,use_quota=True,user_id='4935ce97dc994501963adc5ec5874441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Creating volume bf2e2b96-b996-4143-92e7-5582aaef8308 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:36:32 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:36:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:32 devstack sudo[99083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308 1073741824
Nov 14 03:36:32 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:33 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308 1073741824" returned: 0 in 0.528s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:33 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308
Nov 14 03:36:33 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:33 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308" returned: 0 in 0.441s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f71d44e-fd28-4699-99ea-051ae713233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2e2b96-b996-4143-92e7-5582aaef8308', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c09db4-6e96-4475-a893-01cba853d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:33 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Volume volume-bf2e2b96-b996-4143-92e7-5582aaef8308 (bf2e2b96-b996-4143-92e7-5582aaef8308): created successfully
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c09db4-6e96-4475-a893-01cba853d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Flow 'volume_create_manager' (1ddd6b52-e3c4-4a9e-a57f-7580bda1271e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f69860e4-6b6e-464a-8872-e17586d3d15c tempest-VolumesTransfersTest-2001710372 None] Created volume successfully.
Nov 14 03:36:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b239a748-a12e-45f5-a422-6d70c6a7c387 tempest-VolumesTransfersTest-435161536 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:35 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b239a748-a12e-45f5-a422-6d70c6a7c387 tempest-VolumesTransfersTest-435161536 None] Transfer volume completed successfully.
Nov 14 03:36:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Acquiring lock "cinder-bf2e2b96-b996-4143-92e7-5582aaef8308-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Lock "cinder-bf2e2b96-b996-4143-92e7-5582aaef8308-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:36 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Acquiring lock "cinder-quobyte-bf2e2b96-b996-4143-92e7-5582aaef8308" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Lock "cinder-quobyte-bf2e2b96-b996-4143-92e7-5582aaef8308" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:36 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9b9de-4d09-4398-897c-6c3648dcdefa]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:36 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308
Nov 14 03:36:36 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:36 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308" returned: 0 in 0.555s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:36 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308
Nov 14 03:36:36 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:37 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-bf2e2b96-b996-4143-92e7-5582aaef8308" returned: 0 in 0.456s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Lock "cinder-quobyte-bf2e2b96-b996-4143-92e7-5582aaef8308" released by "delete_volume" :: held 1.042s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Created reservations ['48b8b5bd-7dbf-48a4-90ae-e043e6b3ff10', '23c94f0c-9707-4c75-b11c-16baee2313aa', 'd3ad2b99-c767-4c72-b22e-c3d3eaa82199', 'da70923a-5520-428a-9ebc-3ed17030992c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:37 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:37 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:37 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.446s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:37 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Deleted volume successfully.
Nov 14 03:36:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8088dc48-de40-4774-b12d-a3942151a21a tempest-VolumesTransfersTest-2020971472 None] Lock "cinder-bf2e2b96-b996-4143-92e7-5582aaef8308-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:38 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Flow 'volume_create_manager' (fec596f1-5cb1-4a95-a9c1-8bfb5ef0f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de54b6ba-7963-421b-b9f3-70341eb831c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de54b6ba-7963-421b-b9f3-70341eb831c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-714951740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547831f6-94f7-435f-8c7a-8964cce03d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c8fd7434a945b89bcf2c5ffa6aa03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:38Z,use_quota=True,user_id='4935ce97dc994501963adc5ec5874441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c460e6-1698-4e71-9cfb-f52e61f9487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c460e6-1698-4e71-9cfb-f52e61f9487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27217142-b8a4-449a-ba20-dea873df8437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27217142-b8a4-449a-ba20-dea873df8437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547831f6-94f7-435f-8c7a-8964cce03d05', 'volume_name': 'volume-547831f6-94f7-435f-8c7a-8964cce03d05', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deacabed-b08a-4c22-9636-924b65ea455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deacabed-b08a-4c22-9636-924b65ea455b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b779758-b623-4183-8f09-882667c1233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:38 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Volume 547831f6-94f7-435f-8c7a-8964cce03d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547831f6-94f7-435f-8c7a-8964cce03d05', 'volume_size': 1}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-714951740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547831f6-94f7-435f-8c7a-8964cce03d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c8fd7434a945b89bcf2c5ffa6aa03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:38Z,use_quota=True,user_id='4935ce97dc994501963adc5ec5874441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Creating volume 547831f6-94f7-435f-8c7a-8964cce03d05 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:36:38 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:36:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:38 devstack sudo[99102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05 1073741824
Nov 14 03:36:38 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:39 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05 1073741824" returned: 0 in 0.514s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:39 devstack sudo[99107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05
Nov 14 03:36:39 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:39 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05" returned: 0 in 0.419s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b779758-b623-4183-8f09-882667c1233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547831f6-94f7-435f-8c7a-8964cce03d05', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1319796b-0c19-477e-b5be-f5b5a10e4872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:39 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Volume volume-547831f6-94f7-435f-8c7a-8964cce03d05 (547831f6-94f7-435f-8c7a-8964cce03d05): created successfully
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1319796b-0c19-477e-b5be-f5b5a10e4872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Flow 'volume_create_manager' (fec596f1-5cb1-4a95-a9c1-8bfb5ef0f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:39 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9ef745b5-b170-4268-8f1e-985987bf2c12 tempest-VolumesTransfersTest-2001710372 None] Created volume successfully.
Nov 14 03:36:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Acquiring lock "cinder-547831f6-94f7-435f-8c7a-8964cce03d05-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Lock "cinder-547831f6-94f7-435f-8c7a-8964cce03d05-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Acquiring lock "cinder-quobyte-547831f6-94f7-435f-8c7a-8964cce03d05" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Lock "cinder-quobyte-547831f6-94f7-435f-8c7a-8964cce03d05" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:40 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6c96e6-de5d-4406-82e0-8ec725d8b8d4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:41 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05
Nov 14 03:36:41 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:41 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05" returned: 0 in 0.536s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:41 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05
Nov 14 03:36:41 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:41 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-547831f6-94f7-435f-8c7a-8964cce03d05" returned: 0 in 0.439s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Lock "cinder-quobyte-547831f6-94f7-435f-8c7a-8964cce03d05" released by "delete_volume" :: held 1.010s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:41 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Created reservations ['8b4e4010-c71d-448b-b47a-1f1a590c9425', 'afbf9537-3d55-4140-9ecd-20026605e698', '28facdec-8c00-400e-bb9d-8838a8a0b956', '70721c15-1ff5-4631-9131-aa8cd1b25ce7'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:42 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:42 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:42 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.443s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:42 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Deleted volume successfully.
Nov 14 03:36:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-85b5ef92-eefc-4e51-92fb-95afd0c9e3b6 tempest-VolumesTransfersTest-2020971472 None] Lock "cinder-547831f6-94f7-435f-8c7a-8964cce03d05-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-db87e1e1-3d92-41ea-be3b-c95065378b44 req-a65e24e5-eb5a-46bd-8168-4d48a39827f8 tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-db87e1e1-3d92-41ea-be3b-c95065378b44 req-a65e24e5-eb5a-46bd-8168-4d48a39827f8 tempest-TestStampPattern-286744405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:45 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c737a1-0b50-493d-8e60-e02a509ce961]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-db87e1e1-3d92-41ea-be3b-c95065378b44 req-a65e24e5-eb5a-46bd-8168-4d48a39827f8 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:45 devstack sudo[99153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba
Nov 14 03:36:45 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:46 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-db87e1e1-3d92-41ea-be3b-c95065378b44 req-a65e24e5-eb5a-46bd-8168-4d48a39827f8 tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba" returned: 0 in 0.633s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-db87e1e1-3d92-41ea-be3b-c95065378b44 req-a65e24e5-eb5a-46bd-8168-4d48a39827f8 tempest-TestStampPattern-286744405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.655s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-db87e1e1-3d92-41ea-be3b-c95065378b44 req-a65e24e5-eb5a-46bd-8168-4d48a39827f8 tempest-TestStampPattern-286744405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-7e5fb714-4661-4687-956d-842bfa100bba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16731b44-a91b-45e0-b36c-59f094484513', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:36:46 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-db87e1e1-3d92-41ea-be3b-c95065378b44 req-a65e24e5-eb5a-46bd-8168-4d48a39827f8 tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:46 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-db87e1e1-3d92-41ea-be3b-c95065378b44 req-a65e24e5-eb5a-46bd-8168-4d48a39827f8 tempest-TestStampPattern-286744405 None] attachment_update completed successfully.
Nov 14 03:36:46 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Flow 'volume_create_manager' (77c91ef2-4ec2-4ab6-9d8f-ae9368264fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddc4bfb-ed16-4990-aad1-395386f99a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddc4bfb-ed16-4990-aad1-395386f99a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-17912434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54becf1-4701-45d7-8e96-5a19e2fa060d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c9400c6fd24425870af1edc036aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:46Z,use_quota=True,user_id='c788c5a7693e4556870eb43d2b989a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd47e7f3-0b1e-498a-a525-70d3d3b03f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd47e7f3-0b1e-498a-a525-70d3d3b03f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c152ca-1f61-4061-8fcd-1769d7d28c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c152ca-1f61-4061-8fcd-1769d7d28c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54becf1-4701-45d7-8e96-5a19e2fa060d', 'volume_name': 'volume-c54becf1-4701-45d7-8e96-5a19e2fa060d', 'volume_size': 2}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15a8ee5-29ad-4905-be87-76ebed0f92a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15a8ee5-29ad-4905-be87-76ebed0f92a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f8a4a2-d525-4fb0-9c52-088ea6a23c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:46 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Volume c54becf1-4701-45d7-8e96-5a19e2fa060d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54becf1-4701-45d7-8e96-5a19e2fa060d', 'volume_size': 2}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-17912434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54becf1-4701-45d7-8e96-5a19e2fa060d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c9400c6fd24425870af1edc036aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:36:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:36:46Z,use_quota=True,user_id='c788c5a7693e4556870eb43d2b989a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Creating volume c54becf1-4701-45d7-8e96-5a19e2fa060d {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:36:46 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:36:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d 2147483648 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:46 devstack sudo[99159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d 2147483648
Nov 14 03:36:46 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:47 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d 2147483648" returned: 0 in 0.570s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:47 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d
Nov 14 03:36:47 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:47 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d" returned: 0 in 0.491s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f8a4a2-d525-4fb0-9c52-088ea6a23c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54becf1-4701-45d7-8e96-5a19e2fa060d', 'volume_size': 2}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4827e9-e668-413e-982f-d2e516b5bac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:36:47 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Volume volume-c54becf1-4701-45d7-8e96-5a19e2fa060d (c54becf1-4701-45d7-8e96-5a19e2fa060d): created successfully
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4827e9-e668-413e-982f-d2e516b5bac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:36:47 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Flow 'volume_create_manager' (77c91ef2-4ec2-4ab6-9d8f-ae9368264fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:36:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-6ce4f738-1cdc-4e0b-8141-e444bbf90027 tempest-VolumesCloneNegativeTest-825143775 None] Created volume successfully.
Nov 14 03:36:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Acquiring lock "cinder-c54becf1-4701-45d7-8e96-5a19e2fa060d-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Lock "cinder-c54becf1-4701-45d7-8e96-5a19e2fa060d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Acquiring lock "cinder-quobyte-c54becf1-4701-45d7-8e96-5a19e2fa060d" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:36:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Lock "cinder-quobyte-c54becf1-4701-45d7-8e96-5a19e2fa060d" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:36:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b42b82-8de0-41e1-9da6-8d9ed4367e68]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:48 devstack sudo[99171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d
Nov 14 03:36:48 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:49 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d" returned: 0 in 0.553s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:49 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d
Nov 14 03:36:49 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:49 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c54becf1-4701-45d7-8e96-5a19e2fa060d" returned: 0 in 0.481s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Lock "cinder-quobyte-c54becf1-4701-45d7-8e96-5a19e2fa060d" released by "delete_volume" :: held 1.068s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Created reservations ['c77b2287-ac4c-48b0-b695-b8c0520b2aaa', '1958c510-c019-4d1d-832d-2d11a107aef3', 'd8fad908-6ec6-4675-9711-06dd54325753', '7355e4d8-fb70-4d6a-bd72-9011dde67dfe'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:49 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:49 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:50 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.447s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:50 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:50 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Deleted volume successfully.
Nov 14 03:36:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3bb295e5-c57e-41bf-90a4-753a6f0901ec tempest-VolumesCloneNegativeTest-825143775 None] Lock "cinder-c54becf1-4701-45d7-8e96-5a19e2fa060d-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:54 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:36:54 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:54 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.480s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:36:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-6262a96b-bf92-4356-a644-9a2c876531da req-5d767a6b-e1d0-4ec7-bd9b-1f6bf2af2567 tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-6262a96b-bf92-4356-a644-9a2c876531da req-5d767a6b-e1d0-4ec7-bd9b-1f6bf2af2567 tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:57 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-6262a96b-bf92-4356-a644-9a2c876531da req-5d767a6b-e1d0-4ec7-bd9b-1f6bf2af2567 tempest-TestStampPattern-286744405 None] Terminate volume connection completed successfully.
Nov 14 03:36:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-6262a96b-bf92-4356-a644-9a2c876531da req-5d767a6b-e1d0-4ec7-bd9b-1f6bf2af2567 tempest-TestStampPattern-286744405 None] Deleting attachment 16731b44-a91b-45e0-b36c-59f094484513. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:36:58 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:36:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:36:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:36:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Creating offline snapshot 788df0d8-248c-43b7-817b-fa25004d04c8 of volume 7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:36:58 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcba61ea-fb60-4c75-8205-4fb68ce6339f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:36:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:58 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba
Nov 14 03:36:58 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:59 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba" returned: 0 in 0.694s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:59 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 1G
Nov 14 03:36:59 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:36:59 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Nov 14 03:36:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 1G" returned: 0 in 0.574s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:36:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5fb714-4661-4687-956d-842bfa100bba -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:36:59 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5fb714-4661-4687-956d-842bfa100bba -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8
Nov 14 03:36:59 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:00 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5fb714-4661-4687-956d-842bfa100bba -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8" returned: 0 in 0.478s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:00 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 is being set with open permissions: ugo+rw
Nov 14 03:37:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:00 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8
Nov 14 03:37:00 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:00 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8" returned: 0 in 0.490s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:00 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.info
Nov 14 03:37:00 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:01 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.info" returned: 0 in 0.504s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:01 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.info is being set with open permissions: ugo+rw
Nov 14 03:37:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:01 devstack sudo[99239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.info
Nov 14 03:37:01 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:01 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.info" returned: 0 in 0.473s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.257s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2ead9911-0ec1-4b32-ac73-f57ed30c015c tempest-TestStampPattern-286744405 None] Create snapshot completed successfully
Nov 14 03:37:08 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Flow 'volume_create_manager' (adaeecf3-d6f0-4b24-9acb-ecdc0805910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3bf3f0-b549-4cce-a351-a1d87ac8f51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3bf3f0-b549-4cce-a351-a1d87ac8f51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-667907530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82eeb227-fc31-4284-87f4-b8980f3dba59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202924118692459186f83a0e737f4fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:37:08Z,use_quota=True,user_id='7b5d2b0359ff490096877dfd021d3105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c43878-3a41-43fe-8ff3-82bcaebf695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c43878-3a41-43fe-8ff3-82bcaebf695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58d7262-939e-4ec9-bd11-6cea5b635305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58d7262-939e-4ec9-bd11-6cea5b635305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82eeb227-fc31-4284-87f4-b8980f3dba59', 'volume_name': 'volume-82eeb227-fc31-4284-87f4-b8980f3dba59', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d091b7-5658-4585-a939-fb7ab01b5e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d091b7-5658-4585-a939-fb7ab01b5e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4945f6e-fbe9-4a00-a81c-d712917eaaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume 82eeb227-fc31-4284-87f4-b8980f3dba59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82eeb227-fc31-4284-87f4-b8980f3dba59', 'volume_size': 1}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-667907530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82eeb227-fc31-4284-87f4-b8980f3dba59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202924118692459186f83a0e737f4fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:37:08Z,use_quota=True,user_id='7b5d2b0359ff490096877dfd021d3105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Creating volume 82eeb227-fc31-4284-87f4-b8980f3dba59 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:37:08 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:08 devstack sudo[99284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59 1073741824
Nov 14 03:37:08 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:08 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Flow 'volume_create_manager' (87eaa8de-4f69-4842-a5c4-f76d6081f611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b528b4-e9ae-4aef-9f8e-de1fb3b88eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b528b4-e9ae-4aef-9f8e-de1fb3b88eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-331911325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec68e05-f0db-4384-82c8-935ca88cff3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202924118692459186f83a0e737f4fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:37:09Z,use_quota=True,user_id='7b5d2b0359ff490096877dfd021d3105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4f5f67-89eb-434c-8f4d-bf6488ad80fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4f5f67-89eb-434c-8f4d-bf6488ad80fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21f53d6-3633-4361-85bd-9448db721747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21f53d6-3633-4361-85bd-9448db721747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec68e05-f0db-4384-82c8-935ca88cff3c', 'volume_name': 'volume-6ec68e05-f0db-4384-82c8-935ca88cff3c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61becfbc-a65a-4f4c-8759-38c5f808b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61becfbc-a65a-4f4c-8759-38c5f808b272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4487cf79-7553-4274-ada3-75bf69c8b157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:08 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume 6ec68e05-f0db-4384-82c8-935ca88cff3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec68e05-f0db-4384-82c8-935ca88cff3c', 'volume_size': 1}
Nov 14 03:37:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:09 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59 1073741824" returned: 0 in 0.778s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:09 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59
Nov 14 03:37:09 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:09 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59" returned: 0 in 0.593s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-331911325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec68e05-f0db-4384-82c8-935ca88cff3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202924118692459186f83a0e737f4fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:37:09Z,use_quota=True,user_id='7b5d2b0359ff490096877dfd021d3105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Creating volume 6ec68e05-f0db-4384-82c8-935ca88cff3c {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:37:09 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4945f6e-fbe9-4a00-a81c-d712917eaaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82eeb227-fc31-4284-87f4-b8980f3dba59', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23f5a96-4f37-4d62-9708-53c5b763ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:09 devstack sudo[99295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c 1073741824
Nov 14 03:37:09 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:09 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume volume-82eeb227-fc31-4284-87f4-b8980f3dba59 (82eeb227-fc31-4284-87f4-b8980f3dba59): created successfully
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23f5a96-4f37-4d62-9708-53c5b763ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Flow 'volume_create_manager' (adaeecf3-d6f0-4b24-9acb-ecdc0805910f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:37:09 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-174994dc-0e6e-442b-91e8-9657d48547e2 tempest-TestServerVolumeAttachmentScenario-386447763 None] Created volume successfully.
Nov 14 03:37:10 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c 1073741824" returned: 0 in 0.742s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:10 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c
Nov 14 03:37:10 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:10 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:37:10 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:37:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Flow 'volume_create_manager' (f21dde44-219f-4c18-9932-9e4d1496b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:37:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f33094-b62a-4f09-a744-8cad5e30d094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f33094-b62a-4f09-a744-8cad5e30d094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-787155094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d4cd3f-7331-44a2-9e88-630b88625c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a682dd1f42364b768b8500d6fe162af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=788df0d8-248c-43b7-817b-fa25004d04c8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:37:11Z,use_quota=True,user_id='1e0c83506b35409a8f5b00ba64b4693c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d366b6-6aa5-47d5-8989-94a4a9b0a487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d366b6-6aa5-47d5-8989-94a4a9b0a487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8507bb57-4ade-41c2-9f56-051c479b13b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8507bb57-4ade-41c2-9f56-051c479b13b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12d4cd3f-7331-44a2-9e88-630b88625c0b', 'volume_name': 'volume-12d4cd3f-7331-44a2-9e88-630b88625c0b', 'volume_size': 1, 'snapshot_id': '788df0d8-248c-43b7-817b-fa25004d04c8'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682c1997-dc81-4ed8-a2cd-508dcd4e661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682c1997-dc81-4ed8-a2cd-508dcd4e661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b845a7f-cd09-403d-8827-2c9c2afadc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Volume 12d4cd3f-7331-44a2-9e88-630b88625c0b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12d4cd3f-7331-44a2-9e88-630b88625c0b', 'volume_size': 1, 'snapshot_id': '788df0d8-248c-43b7-817b-fa25004d04c8'}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:11 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c" returned: 0 in 0.608s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.165s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-quobyte-788df0d8-248c-43b7-817b-fa25004d04c8-12d4cd3f-7331-44a2-9e88-630b88625c0b" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4487cf79-7553-4274-ada3-75bf69c8b157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec68e05-f0db-4384-82c8-935ca88cff3c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29258d34-c89d-4dcf-99c7-cefa04541dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume volume-6ec68e05-f0db-4384-82c8-935ca88cff3c (6ec68e05-f0db-4384-82c8-935ca88cff3c): created successfully
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29258d34-c89d-4dcf-99c7-cefa04541dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Flow 'volume_create_manager' (87eaa8de-4f69-4842-a5c4-f76d6081f611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-788df0d8-248c-43b7-817b-fa25004d04c8-12d4cd3f-7331-44a2-9e88-630b88625c0b" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Creating volume 12d4cd3f-7331-44a2-9e88-630b88625c0b from snapshot 788df0d8-248c-43b7-817b-fa25004d04c8 {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-quobyte-12d4cd3f-7331-44a2-9e88-630b88625c0b" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:37:11 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8557267c-710e-42fa-8ddd-c70d2a03b760 tempest-TestServerVolumeAttachmentScenario-386447763 None] Created volume successfully.
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-12d4cd3f-7331-44a2-9e88-630b88625c0b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] snapshot: 788df0d8-248c-43b7-817b-fa25004d04c8, volume: 12d4cd3f-7331-44a2-9e88-630b88625c0b,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4186922-c61a-4613-b1eb-04dcdd6d035c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:37:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:11 devstack sudo[99308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8
Nov 14 03:37:11 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:12 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8" returned: 0 in 0.689s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5fb714-4661-4687-956d-842bfa100bba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2dcfd-8448-4cd9-a141-1294425b40d1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:12 devstack sudo[99315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba
Nov 14 03:37:12 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:12 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba" returned: 0 in 0.620s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:12 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b
Nov 14 03:37:12 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-5a8c87f2-6f7f-4f43-8012-1492fff92f4d req-77822df5-27bc-47a9-80c8-6c682f88f83c tempest-TestMinimumBasicScenario-260141506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:37:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-5a8c87f2-6f7f-4f43-8012-1492fff92f4d req-77822df5-27bc-47a9-80c8-6c682f88f83c tempest-TestMinimumBasicScenario-260141506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:37:12 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-5a8c87f2-6f7f-4f43-8012-1492fff92f4d req-77822df5-27bc-47a9-80c8-6c682f88f83c tempest-TestMinimumBasicScenario-260141506 None] Terminate volume connection completed successfully.
Nov 14 03:37:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-5a8c87f2-6f7f-4f43-8012-1492fff92f4d req-77822df5-27bc-47a9-80c8-6c682f88f83c tempest-TestMinimumBasicScenario-260141506 None] Deleting attachment fd094fa1-1545-4108-8403-f3ef03521a65. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:37:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Acquiring lock "cinder-4f8e8528-e19f-4910-883f-050115ef30d9-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:37:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Lock "cinder-4f8e8528-e19f-4910-883f-050115ef30d9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:37:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:37:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Acquiring lock "cinder-quobyte-4f8e8528-e19f-4910-883f-050115ef30d9" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:37:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Lock "cinder-quobyte-4f8e8528-e19f-4910-883f-050115ef30d9" acquired by "delete_volume" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:37:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf115230-cfec-4712-b0a8-3b1af5571c4a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:37:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:15 devstack sudo[99337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9
Nov 14 03:37:15 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:15 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b" returned: 0 in 2.738s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:15 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18ffae9-b99b-4184-9344-e9a3f55f2ea4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:37:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:15 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba
Nov 14 03:37:15 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:15 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9" returned: 0 in 0.977s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:15 devstack sudo[99345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9
Nov 14 03:37:15 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:16 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba" returned: 0 in 0.759s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba, size 1024.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:37:16 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Converted 1024.00 MB image at 373.65 MB/s
Nov 14 03:37:16 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b is being set with open permissions: ugo+rw
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:16 devstack sudo[99350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b
Nov 14 03:37:16 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:16 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-4f8e8528-e19f-4910-883f-050115ef30d9" returned: 0 in 0.607s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Lock "cinder-quobyte-4f8e8528-e19f-4910-883f-050115ef30d9" released by "delete_volume" :: held 1.631s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Created reservations ['6f4cee1d-48fe-4a9a-844f-c9ea66c87ecc', 'd4f7af81-f5d9-4038-b2b6-dd1fb91139fc', 'ef9e0cd3-4eb5-4686-9bab-06a54e8b7bb8', 'cca301ae-57f0-44af-b436-efd7d12bc877'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:16 devstack sudo[99357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:37:16 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:16 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b" returned: 0 in 0.608s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-12d4cd3f-7331-44a2-9e88-630b88625c0b" released by "_copy_volume_from_snapshot" :: held 5.485s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-788df0d8-248c-43b7-817b-fa25004d04c8-12d4cd3f-7331-44a2-9e88-630b88625c0b" released by "_create_volume_from_snapshot" :: held 5.516s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.548s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b845a7f-cd09-403d-8827-2c9c2afadc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d4cd3f-7331-44a2-9e88-630b88625c0b', 'volume_size': 1, 'snapshot_id': '788df0d8-248c-43b7-817b-fa25004d04c8'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd306f1-7f90-44f8-ada4-abcf354a057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:37:16 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Volume volume-12d4cd3f-7331-44a2-9e88-630b88625c0b (12d4cd3f-7331-44a2-9e88-630b88625c0b): created successfully
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd306f1-7f90-44f8-ada4-abcf354a057a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:37:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Flow 'volume_create_manager' (f21dde44-219f-4c18-9932-9e4d1496b355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:37:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-97172a49-6adf-4909-ab6f-de8f24b9006e tempest-TestStampPattern-286744405 None] Created volume successfully.
Nov 14 03:37:17 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.727s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:17 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:37:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Deleted volume successfully.
Nov 14 03:37:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9f3b7c04-40b6-4fe6-8b96-7edb2b228396 tempest-TestMinimumBasicScenario-260141506 None] Lock "cinder-4f8e8528-e19f-4910-883f-050115ef30d9-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:37:26 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=51,cinder:INSERT=17,cinder:UPDATE=59,cinder:DELETE=6 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:37:27 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=31,cinder:UPDATE=43,cinder:DELETE=7,cinder:INSERT=7 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:37:54 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:37:54 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:37:54 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.446s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:37:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:38:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:38:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=1 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:38:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d360ce9d-5eb0-4ee3-92b7-1b98a252d3a2 req-4f58576b-0781-481c-b038-3464325b4c4c tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:38:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d360ce9d-5eb0-4ee3-92b7-1b98a252d3a2 req-4f58576b-0781-481c-b038-3464325b4c4c tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:38:32 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc729a8-4d56-41db-869d-7242cc925ad6]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:38:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d360ce9d-5eb0-4ee3-92b7-1b98a252d3a2 req-4f58576b-0781-481c-b038-3464325b4c4c tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:32 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59
Nov 14 03:38:32 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:33 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-d360ce9d-5eb0-4ee3-92b7-1b98a252d3a2 req-4f58576b-0781-481c-b038-3464325b4c4c tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59" returned: 0 in 0.582s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-d360ce9d-5eb0-4ee3-92b7-1b98a252d3a2 req-4f58576b-0781-481c-b038-3464325b4c4c tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.601s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:38:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-d360ce9d-5eb0-4ee3-92b7-1b98a252d3a2 req-4f58576b-0781-481c-b038-3464325b4c4c tempest-TestServerVolumeAttachmentScenario-386447763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-82eeb227-fc31-4284-87f4-b8980f3dba59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41f90b7a-4ae7-41d0-9d68-84a32de4c1ce', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:38:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-d360ce9d-5eb0-4ee3-92b7-1b98a252d3a2 req-4f58576b-0781-481c-b038-3464325b4c4c tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-d360ce9d-5eb0-4ee3-92b7-1b98a252d3a2 req-4f58576b-0781-481c-b038-3464325b4c4c tempest-TestServerVolumeAttachmentScenario-386447763 None] attachment_update completed successfully.
Nov 14 03:38:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f2717362-c3d2-44c9-87c2-05168bff92bf req-dbfbfb6e-86ad-44b2-b329-fb3d0b435306 tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:38:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f2717362-c3d2-44c9-87c2-05168bff92bf req-dbfbfb6e-86ad-44b2-b329-fb3d0b435306 tempest-TestStampPattern-286744405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:38:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489b3c9-ee78-466d-a582-027a5b406f44]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:38:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-f2717362-c3d2-44c9-87c2-05168bff92bf req-dbfbfb6e-86ad-44b2-b329-fb3d0b435306 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:34 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b
Nov 14 03:38:34 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:35 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-f2717362-c3d2-44c9-87c2-05168bff92bf req-dbfbfb6e-86ad-44b2-b329-fb3d0b435306 tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b" returned: 0 in 0.607s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-f2717362-c3d2-44c9-87c2-05168bff92bf req-dbfbfb6e-86ad-44b2-b329-fb3d0b435306 tempest-TestStampPattern-286744405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.624s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:38:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-f2717362-c3d2-44c9-87c2-05168bff92bf req-dbfbfb6e-86ad-44b2-b329-fb3d0b435306 tempest-TestStampPattern-286744405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-12d4cd3f-7331-44a2-9e88-630b88625c0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1c4d941-535f-4ab0-9ee0-e976a111d567', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:38:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-f2717362-c3d2-44c9-87c2-05168bff92bf req-dbfbfb6e-86ad-44b2-b329-fb3d0b435306 tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:35 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-f2717362-c3d2-44c9-87c2-05168bff92bf req-dbfbfb6e-86ad-44b2-b329-fb3d0b435306 tempest-TestStampPattern-286744405 None] attachment_update completed successfully.
Nov 14 03:38:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ef36fadd-ca79-455e-b6b3-7356ca9b775d req-ed14bc31-bc5b-46f7-a2ba-6a113cabf538 tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:38:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ef36fadd-ca79-455e-b6b3-7356ca9b775d req-ed14bc31-bc5b-46f7-a2ba-6a113cabf538 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:38:41 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[137e2a28-f7e3-41cb-b9fd-95d6a08a4099]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:38:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-ef36fadd-ca79-455e-b6b3-7356ca9b775d req-ed14bc31-bc5b-46f7-a2ba-6a113cabf538 tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:42 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c
Nov 14 03:38:42 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:42 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [req-ef36fadd-ca79-455e-b6b3-7356ca9b775d req-ed14bc31-bc5b-46f7-a2ba-6a113cabf538 tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c" returned: 0 in 0.585s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [req-ef36fadd-ca79-455e-b6b3-7356ca9b775d req-ed14bc31-bc5b-46f7-a2ba-6a113cabf538 tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.602s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:38:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-ef36fadd-ca79-455e-b6b3-7356ca9b775d req-ed14bc31-bc5b-46f7-a2ba-6a113cabf538 tempest-TestServerVolumeAttachmentScenario-386447763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead', 'name': 'volume-6ec68e05-f0db-4384-82c8-935ca88cff3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '710a9f27-260f-44b0-bc76-0efcbe836735', 'enforce_multipath': True} {{(pid=80846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Nov 14 03:38:42 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-ef36fadd-ca79-455e-b6b3-7356ca9b775d req-ed14bc31-bc5b-46f7-a2ba-6a113cabf538 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:42 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-ef36fadd-ca79-455e-b6b3-7356ca9b775d req-ed14bc31-bc5b-46f7-a2ba-6a113cabf538 tempest-TestServerVolumeAttachmentScenario-386447763 None] attachment_update completed successfully.
Nov 14 03:38:44 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-21c0f4de-f64a-4615-885c-ec432bd46c05 req-97e3d948-e7d5-4507-b3f6-4724ac35b5ca tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:44 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-21c0f4de-f64a-4615-885c-ec432bd46c05 req-97e3d948-e7d5-4507-b3f6-4724ac35b5ca tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-21c0f4de-f64a-4615-885c-ec432bd46c05 req-97e3d948-e7d5-4507-b3f6-4724ac35b5ca tempest-TestStampPattern-286744405 None] Terminate volume connection completed successfully.
Nov 14 03:38:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-21c0f4de-f64a-4615-885c-ec432bd46c05 req-97e3d948-e7d5-4507-b3f6-4724ac35b5ca tempest-TestStampPattern-286744405 None] Deleting attachment f1c4d941-535f-4ab0-9ee0-e976a111d567. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:38:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-4321e457-eca5-4fd4-8f3d-5b30479df6b2 req-b25c82b2-be09-49d0-93e7-cac48df15db0 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-4321e457-eca5-4fd4-8f3d-5b30479df6b2 req-b25c82b2-be09-49d0-93e7-cac48df15db0 tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:48 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-4321e457-eca5-4fd4-8f3d-5b30479df6b2 req-b25c82b2-be09-49d0-93e7-cac48df15db0 tempest-TestServerVolumeAttachmentScenario-386447763 None] Terminate volume connection completed successfully.
Nov 14 03:38:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-4321e457-eca5-4fd4-8f3d-5b30479df6b2 req-b25c82b2-be09-49d0-93e7-cac48df15db0 tempest-TestServerVolumeAttachmentScenario-386447763 None] Deleting attachment 710a9f27-260f-44b0-bc76-0efcbe836735. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:38:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-ac8aebd6-0f8e-400f-beff-8a9f41ea881e req-175b93ef-2c81-45aa-9453-b62c6412722e tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [req-ac8aebd6-0f8e-400f-beff-8a9f41ea881e req-175b93ef-2c81-45aa-9453-b62c6412722e tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:52 devstack cinder-volume[80846]: INFO cinder.volume.manager [req-ac8aebd6-0f8e-400f-beff-8a9f41ea881e req-175b93ef-2c81-45aa-9453-b62c6412722e tempest-TestServerVolumeAttachmentScenario-386447763 None] Terminate volume connection completed successfully.
Nov 14 03:38:52 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [req-ac8aebd6-0f8e-400f-beff-8a9f41ea881e req-175b93ef-2c81-45aa-9453-b62c6412722e tempest-TestServerVolumeAttachmentScenario-386447763 None] Deleting attachment 41f90b7a-4ae7-41d0-9d68-84a32de4c1ce. {{(pid=80846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Nov 14 03:38:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-12d4cd3f-7331-44a2-9e88-630b88625c0b-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:38:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Lock "cinder-12d4cd3f-7331-44a2-9e88-630b88625c0b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:38:53 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-quobyte-12d4cd3f-7331-44a2-9e88-630b88625c0b" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:38:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-12d4cd3f-7331-44a2-9e88-630b88625c0b" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:38:53 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[63448e80-49af-4a0a-b6d4-77981f5298e8]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:38:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:53 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b
Nov 14 03:38:53 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:53 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b" returned: 0 in 0.557s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:53 devstack sudo[100262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b
Nov 14 03:38:53 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:54 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:38:54 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:54 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d4cd3f-7331-44a2-9e88-630b88625c0b" returned: 0 in 0.472s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-12d4cd3f-7331-44a2-9e88-630b88625c0b" released by "delete_volume" :: held 1.060s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Created reservations ['41f1b355-32f9-4fa0-9d8b-f81d6ad6384e', 'ad400231-3c42-48a2-8375-06402a3452e5', 'bf469786-e68b-4c12-bf9e-4538ac514c06', 'aeece2c6-f3e4-4d25-8e39-ce386446b751'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:54 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:38:54 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:54 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.464s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:38:54 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.522s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:38:54 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Deleted volume successfully.
Nov 14 03:38:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-619afd57-214d-4f39-b440-2751ce97162a tempest-TestStampPattern-286744405 None] Lock "cinder-12d4cd3f-7331-44a2-9e88-630b88625c0b-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-788df0d8-248c-43b7-817b-fa25004d04c8-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Lock "cinder-788df0d8-248c-43b7-817b-fa25004d04c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:38:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-quobyte-7e5fb714-4661-4687-956d-842bfa100bba" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-7e5fb714-4661-4687-956d-842bfa100bba" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-quobyte-788df0d8-248c-43b7-817b-fa25004d04c8" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-788df0d8-248c-43b7-817b-fa25004d04c8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Deleting offline snapshot 788df0d8-248c-43b7-817b-fa25004d04c8 of volume 7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] snapshot_file for this snap is: volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e0f2f9-c9ec-4387-aa69-2e038a0f2b02]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:38:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:55 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8
Nov 14 03:38:55 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:56 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8" returned: 0 in 0.659s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5fb714-4661-4687-956d-842bfa100bba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:38:56 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb95d5-1e72-4864-b786-5e87e59cc9fe]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:38:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:56 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba
Nov 14 03:38:56 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:56 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba" returned: 0 in 0.646s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:56 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8
Nov 14 03:38:56 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:57 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8" returned: 0 in 0.512s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:38:57 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8
Nov 14 03:38:57 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:38:57 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Nov 14 03:38:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba.788df0d8-248c-43b7-817b-fa25004d04c8" returned: 0 in 0.449s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:38:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-788df0d8-248c-43b7-817b-fa25004d04c8" released by "_delete_snapshot" :: held 2.341s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:38:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-7e5fb714-4661-4687-956d-842bfa100bba" released by "delete_snapshot" :: held 2.352s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:38:57 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Created reservations ['1bab8abc-0fb4-4895-ae70-c6e22a130b7c', 'fefd47b8-7efa-4bed-91a6-2b4ed8ab5dcd', '39a4863f-63ab-435e-9716-15aa73a85c16', '9f486d89-2f62-4f85-bf64-c98cd852a049'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:38:57 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Delete snapshot completed successfully.
Nov 14 03:38:57 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-61f74219-5ba2-48f8-b24b-d455dc077b19 tempest-TestStampPattern-286744405 None] Lock "cinder-788df0d8-248c-43b7-817b-fa25004d04c8-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "cinder-6ec68e05-f0db-4384-82c8-935ca88cff3c-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "cinder-6ec68e05-f0db-4384-82c8-935ca88cff3c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:01 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "cinder-quobyte-6ec68e05-f0db-4384-82c8-935ca88cff3c" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "cinder-quobyte-6ec68e05-f0db-4384-82c8-935ca88cff3c" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:01 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ec458d-2fca-462d-8b01-aa325a946f13]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:01 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c
Nov 14 03:39:01 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:01 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c" returned: 0 in 0.602s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:02 devstack sudo[100375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c
Nov 14 03:39:02 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:02 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6ec68e05-f0db-4384-82c8-935ca88cff3c" returned: 0 in 0.433s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "cinder-quobyte-6ec68e05-f0db-4384-82c8-935ca88cff3c" released by "delete_volume" :: held 1.064s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Created reservations ['21b77465-0c84-4ff6-aa5f-0e7961a550b7', 'd26e29b2-ffbc-4084-8285-f0b232bd8687', '03fb0436-37df-42f5-a2b3-b016277e4ce1', '4071823e-b6db-4102-884f-d4279941bb14'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:02 devstack sudo[100378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:02 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:02 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.438s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:02 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Deleted volume successfully.
Nov 14 03:39:02 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-abb88dc6-1ccd-4b41-a599-2d8631ea5f0c tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "cinder-6ec68e05-f0db-4384-82c8-935ca88cff3c-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "cinder-82eeb227-fc31-4284-87f4-b8980f3dba59-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "cinder-82eeb227-fc31-4284-87f4-b8980f3dba59-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "cinder-quobyte-82eeb227-fc31-4284-87f4-b8980f3dba59" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "cinder-quobyte-82eeb227-fc31-4284-87f4-b8980f3dba59" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:03 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e24cdc7-2349-4bee-815d-0aedf05b84bd]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:03 devstack sudo[100381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59
Nov 14 03:39:03 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:04 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59" returned: 0 in 0.598s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:04 devstack sudo[100386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59
Nov 14 03:39:04 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:04 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82eeb227-fc31-4284-87f4-b8980f3dba59" returned: 0 in 0.464s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "cinder-quobyte-82eeb227-fc31-4284-87f4-b8980f3dba59" released by "delete_volume" :: held 1.097s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Created reservations ['b1cd917f-a4ea-4616-bb72-86fa1412bee7', '2fd98f64-5a9a-446c-b32c-115d3eeca8fd', '09f07308-629b-4694-b33a-d0ff626a5b50', 'd53041c3-1ef6-48c7-a709-ee5530c82184'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:04 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:04 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:05 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.463s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:05 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:05 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Deleted volume successfully.
Nov 14 03:39:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3eb60841-ce22-40a4-8178-f5899eb3457f tempest-TestServerVolumeAttachmentScenario-386447763 None] Lock "cinder-82eeb227-fc31-4284-87f4-b8980f3dba59-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-7e5fb714-4661-4687-956d-842bfa100bba-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Lock "cinder-7e5fb714-4661-4687-956d-842bfa100bba-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Acquiring lock "cinder-quobyte-7e5fb714-4661-4687-956d-842bfa100bba" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-7e5fb714-4661-4687-956d-842bfa100bba" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e5173-9f89-4ff2-b7e6-a90b40edcb37]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:06 devstack sudo[100392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba
Nov 14 03:39:06 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:06 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba" returned: 0 in 0.608s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:07 devstack sudo[100398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba
Nov 14 03:39:07 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:07 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7e5fb714-4661-4687-956d-842bfa100bba" returned: 0 in 0.487s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Lock "cinder-quobyte-7e5fb714-4661-4687-956d-842bfa100bba" released by "delete_volume" :: held 1.137s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Created reservations ['c84b67c3-746c-4853-aee4-9cb51b736683', '78a6548a-7008-45b3-879f-5368f66c4942', '3bf60223-f30f-46ea-9276-0463463919d3', '4cd4f485-37b5-4294-8cb2-8b62184e913f'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:07 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:07 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:08 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.467s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:08 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:08 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Deleted volume successfully.
Nov 14 03:39:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d6624852-44c3-4cd7-a1f3-3a0faa613fc8 tempest-TestStampPattern-286744405 None] Lock "cinder-7e5fb714-4661-4687-956d-842bfa100bba-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (b09fad3c-8c39-49e8-92d0-27e9c04023d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc8ce3a-0ead-4c79-b47f-a77a6bd4775d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc8ce3a-0ead-4c79-b47f-a77a6bd4775d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730541812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6760dae9-56ec-41cd-a61a-588d44f71333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:13Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b34d60d-b993-41bc-bed4-e485fe323060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b34d60d-b993-41bc-bed4-e485fe323060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343472e1-3701-4c70-ada5-c4599792f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343472e1-3701-4c70-ada5-c4599792f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6760dae9-56ec-41cd-a61a-588d44f71333', 'volume_name': 'volume-6760dae9-56ec-41cd-a61a-588d44f71333', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f31b8d-018e-4e14-9b44-dbfe73403ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f31b8d-018e-4e14-9b44-dbfe73403ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40e25b1-9b68-4940-a282-fdc847047d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Volume 6760dae9-56ec-41cd-a61a-588d44f71333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6760dae9-56ec-41cd-a61a-588d44f71333', 'volume_size': 1}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730541812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6760dae9-56ec-41cd-a61a-588d44f71333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:13Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Creating volume 6760dae9-56ec-41cd-a61a-588d44f71333 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:13 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:13 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333 1073741824
Nov 14 03:39:13 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (ee951400-df9e-4099-bc56-e28cc4d0fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a6f2c2-513b-4f42-b2e6-38b7d3bcf026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a6f2c2-513b-4f42-b2e6-38b7d3bcf026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-500508511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9f8a79-554c-47e3-878c-ffb653367517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:13Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c0bfdb-9a4f-450f-bc92-8c499449b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c0bfdb-9a4f-450f-bc92-8c499449b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddddd039-21ba-4f12-9c3b-6dd69bb2c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddddd039-21ba-4f12-9c3b-6dd69bb2c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9f8a79-554c-47e3-878c-ffb653367517', 'volume_name': 'volume-da9f8a79-554c-47e3-878c-ffb653367517', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dee6d48-2fdf-4061-9178-1fb9b21aa86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dee6d48-2fdf-4061-9178-1fb9b21aa86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538459c8-98f6-4ae6-90ce-aa368baa33e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Volume da9f8a79-554c-47e3-878c-ffb653367517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9f8a79-554c-47e3-878c-ffb653367517', 'volume_size': 1}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (1e9a22cb-ccb2-4243-9b50-af2dca53cdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84b7830-af22-4a12-b57e-c30ec37bbb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84b7830-af22-4a12-b57e-c30ec37bbb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-115109570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f009702a-4286-4c51-8eaf-e8f03b62a3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:13Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6074e65-c155-427d-850a-28af18b83585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6074e65-c155-427d-850a-28af18b83585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2af098-3f25-4e58-ac79-ee08a837f3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2af098-3f25-4e58-ac79-ee08a837f3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f009702a-4286-4c51-8eaf-e8f03b62a3ce', 'volume_name': 'volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d0a72d-21ae-4374-b3c1-31e9ad16e533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d0a72d-21ae-4374-b3c1-31e9ad16e533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006ecc1b-f3be-45d5-8cd1-caf3a6b423ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Volume f009702a-4286-4c51-8eaf-e8f03b62a3ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce', 'volume_size': 1}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (c8d598c6-8c8c-477f-85f2-b28715f07306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a019d021-ff03-4a0f-8aa3-da1cb81b790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a019d021-ff03-4a0f-8aa3-da1cb81b790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125825950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c446ab1-f2af-4023-9993-25322b588d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:14Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012e6598-9be5-4798-a64d-0f44b070213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012e6598-9be5-4798-a64d-0f44b070213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f99e18-523f-410d-94a0-6f4b1d801e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f99e18-523f-410d-94a0-6f4b1d801e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c446ab1-f2af-4023-9993-25322b588d3c', 'volume_name': 'volume-0c446ab1-f2af-4023-9993-25322b588d3c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ef7277-703c-41eb-b11a-ba8344e2aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ef7277-703c-41eb-b11a-ba8344e2aacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b150a391-f0a7-4644-bf15-564c788dc34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Volume 0c446ab1-f2af-4023-9993-25322b588d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c446ab1-f2af-4023-9993-25322b588d3c', 'volume_size': 1}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (a6e9e8e0-1bf1-4398-b315-69dd78749575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49298e3b-7849-4441-b041-90b1b1b7cc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49298e3b-7849-4441-b041-90b1b1b7cc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1899399087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e24793d-7d78-41db-8d74-b832b72a9979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:14Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ca6524-45b1-40d0-a0d2-eee051cd3452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ca6524-45b1-40d0-a0d2-eee051cd3452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dbb6d98-e0ea-4e51-bf94-d4494d23f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dbb6d98-e0ea-4e51-bf94-d4494d23f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e24793d-7d78-41db-8d74-b832b72a9979', 'volume_name': 'volume-6e24793d-7d78-41db-8d74-b832b72a9979', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce3878a-7014-4e3e-97bf-eeaf152a3c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce3878a-7014-4e3e-97bf-eeaf152a3c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8365f677-e26e-4568-9aee-bafc76c95fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Volume 6e24793d-7d78-41db-8d74-b832b72a9979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e24793d-7d78-41db-8d74-b832b72a9979', 'volume_size': 1}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333 1073741824" returned: 0 in 0.813s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:13 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333
Nov 14 03:39:13 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:14 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333" returned: 0 in 0.501s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-500508511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9f8a79-554c-47e3-878c-ffb653367517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:13Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Creating volume da9f8a79-554c-47e3-878c-ffb653367517 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:14 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40e25b1-9b68-4940-a282-fdc847047d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6760dae9-56ec-41cd-a61a-588d44f71333', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:14 devstack sudo[100420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517 1073741824
Nov 14 03:39:14 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d74f21-1935-4474-9936-98ce4e1f306e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:14 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Volume volume-6760dae9-56ec-41cd-a61a-588d44f71333 (6760dae9-56ec-41cd-a61a-588d44f71333): created successfully
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d74f21-1935-4474-9936-98ce4e1f306e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:14 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (b09fad3c-8c39-49e8-92d0-27e9c04023d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-aa32c10c-0d5f-4ac7-847f-0b12e8a7ea7b tempest-CreateVolumesFromImageTest-1693669573 None] Created volume successfully.
Nov 14 03:39:15 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517 1073741824" returned: 0 in 0.637s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:15 devstack sudo[100425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517
Nov 14 03:39:15 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:15 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517" returned: 0 in 0.523s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.038s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-115109570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f009702a-4286-4c51-8eaf-e8f03b62a3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:13Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Creating volume f009702a-4286-4c51-8eaf-e8f03b62a3ce {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:15 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538459c8-98f6-4ae6-90ce-aa368baa33e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9f8a79-554c-47e3-878c-ffb653367517', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:15 devstack sudo[100430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce 1073741824
Nov 14 03:39:15 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae7c393-1b9a-4618-bcbe-b46cb8b23fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:15 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Volume volume-da9f8a79-554c-47e3-878c-ffb653367517 (da9f8a79-554c-47e3-878c-ffb653367517): created successfully
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae7c393-1b9a-4618-bcbe-b46cb8b23fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (ee951400-df9e-4099-bc56-e28cc4d0fced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:15 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8491e0a0-4595-4dca-8f20-a3732c2365c1 tempest-CreateVolumesFromImageTest-1693669573 None] Created volume successfully.
Nov 14 03:39:16 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Flow 'volume_create_manager' (a3a25c55-d598-4d8f-b9fa-5fe986624d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70e8e9a-0fc3-4fe1-90d5-8f8244d50522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70e8e9a-0fc3-4fe1-90d5-8f8244d50522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1684975794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2f55f0-497e-40e9-8aa1-905738baf7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42056e50c9ed4dcb845eaf12d772fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:16Z,use_quota=True,user_id='3e08b9970ee14bfc80aaf2e2ae756d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219ffa4a-f801-47c5-bf09-6d9a57c4f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219ffa4a-f801-47c5-bf09-6d9a57c4f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5885df-2f12-4b13-8d34-13f10ef20be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5885df-2f12-4b13-8d34-13f10ef20be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2f55f0-497e-40e9-8aa1-905738baf7d3', 'volume_name': 'volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2cd9c6-4e70-4d7d-90d9-7b3365650c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2cd9c6-4e70-4d7d-90d9-7b3365650c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c79f94b-9426-49bc-9aa6-2d9173fecc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:16 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Volume 9e2f55f0-497e-40e9-8aa1-905738baf7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3', 'volume_size': 1}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:16 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce 1073741824" returned: 0 in 0.606s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:16 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce
Nov 14 03:39:16 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:16 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce" returned: 0 in 0.455s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.946s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125825950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c446ab1-f2af-4023-9993-25322b588d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:14Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Creating volume 0c446ab1-f2af-4023-9993-25322b588d3c {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:16 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:16 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c 1073741824
Nov 14 03:39:16 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006ecc1b-f3be-45d5-8cd1-caf3a6b423ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd481ad-3d38-4b73-b48c-ea2d873389ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:16 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Volume volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce (f009702a-4286-4c51-8eaf-e8f03b62a3ce): created successfully
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd481ad-3d38-4b73-b48c-ea2d873389ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (1e9a22cb-ccb2-4243-9b50-af2dca53cdf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-fc31a56a-56e7-4980-b05e-2ab2c86613b3 tempest-CreateVolumesFromImageTest-1693669573 None] Created volume successfully.
Nov 14 03:39:17 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c 1073741824" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:17 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c
Nov 14 03:39:17 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:17 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c" returned: 0 in 0.437s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.785s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1899399087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e24793d-7d78-41db-8d74-b832b72a9979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659d11a6b11647f7b76e263ed642696d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:14Z,use_quota=True,user_id='3d24b746e2134258b8f0a5dbd290d834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Creating volume 6e24793d-7d78-41db-8d74-b832b72a9979 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:17 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b150a391-f0a7-4644-bf15-564c788dc34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c446ab1-f2af-4023-9993-25322b588d3c', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:17 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979 1073741824
Nov 14 03:39:17 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676d3664-5186-429b-9bea-28885378a44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:17 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Volume volume-0c446ab1-f2af-4023-9993-25322b588d3c (0c446ab1-f2af-4023-9993-25322b588d3c): created successfully
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676d3664-5186-429b-9bea-28885378a44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (c8d598c6-8c8c-477f-85f2-b28715f07306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b3f6d04e-5482-4c7f-959f-6211d9814038 tempest-CreateVolumesFromImageTest-1693669573 None] Created volume successfully.
Nov 14 03:39:18 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979 1073741824" returned: 0 in 0.549s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:18 devstack sudo[100451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979
Nov 14 03:39:18 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:18 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979" returned: 0 in 0.431s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.511s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1684975794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2f55f0-497e-40e9-8aa1-905738baf7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42056e50c9ed4dcb845eaf12d772fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:16Z,use_quota=True,user_id='3e08b9970ee14bfc80aaf2e2ae756d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Creating volume 9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:18 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8365f677-e26e-4568-9aee-bafc76c95fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e24793d-7d78-41db-8d74-b832b72a9979', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd53a8fb-2506-4848-9d7e-e03e0f1d7e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:18 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 1073741824
Nov 14 03:39:18 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:18 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Volume volume-6e24793d-7d78-41db-8d74-b832b72a9979 (6e24793d-7d78-41db-8d74-b832b72a9979): created successfully
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd53a8fb-2506-4848-9d7e-e03e0f1d7e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:18 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Flow 'volume_create_manager' (a6e9e8e0-1bf1-4398-b315-69dd78749575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:18 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-cd8942cc-810f-4735-8866-31e7328fa0ab tempest-CreateVolumesFromImageTest-1693669573 None] Created volume successfully.
Nov 14 03:39:19 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 1073741824" returned: 0 in 0.546s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:19 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3
Nov 14 03:39:19 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-6e24793d-7d78-41db-8d74-b832b72a9979-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-6e24793d-7d78-41db-8d74-b832b72a9979-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:19 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-quobyte-6e24793d-7d78-41db-8d74-b832b72a9979" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-6e24793d-7d78-41db-8d74-b832b72a9979" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf45e4a4-9f85-45b4-a1f9-e11861e2a8b3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:19 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979
Nov 14 03:39:19 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:19 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3" returned: 0 in 0.452s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c79f94b-9426-49bc-9aa6-2d9173fecc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f0357d-0357-4b2a-9c77-a5c1265fa637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Volume volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 (9e2f55f0-497e-40e9-8aa1-905738baf7d3): created successfully
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f0357d-0357-4b2a-9c77-a5c1265fa637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Flow 'volume_create_manager' (a3a25c55-d598-4d8f-b9fa-5fe986624d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-369c5af8-abfd-4ccf-b0ce-8ec95a605155 tempest-VolumeDependencyTests-2050111184 None] Created volume successfully.
Nov 14 03:39:19 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979" returned: 0 in 0.565s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:19 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979
Nov 14 03:39:19 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Creating offline snapshot 32e0a85d-4584-4ce5-9909-37e77deda484 of volume 9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fdc7a6-f12b-4322-a54d-1f24b27b4c82]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:20 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6e24793d-7d78-41db-8d74-b832b72a9979" returned: 0 in 0.523s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-6e24793d-7d78-41db-8d74-b832b72a9979" released by "delete_volume" :: held 1.124s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Created reservations ['963de991-61c7-49e6-9eb5-97de5df5a13e', '81defdc5-0a63-47eb-b867-def6bfe7712a', 'cc754aca-29df-484d-8c05-7fe65fb91990', '3aab1cff-b188-41fe-9f38-6d4878f4b1b5'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:20 devstack sudo[100471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:20 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:20 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3
Nov 14 03:39:20 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:20 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.453s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:20 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:21 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Deleted volume successfully.
Nov 14 03:39:21 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3" returned: 0 in 0.560s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-319b3c22-b003-41ac-87ed-c19e62614b9f tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-6e24793d-7d78-41db-8d74-b832b72a9979-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:21 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 1G
Nov 14 03:39:21 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-0c446ab1-f2af-4023-9993-25322b588d3c-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-0c446ab1-f2af-4023-9993-25322b588d3c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:21 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-quobyte-0c446ab1-f2af-4023-9993-25322b588d3c" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-0c446ab1-f2af-4023-9993-25322b588d3c" acquired by "delete_volume" :: waited 0.021s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6994c0a-617d-4f3f-a189-d8c138c5abb4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:21 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 1G" returned: 0 in 0.567s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:21 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484
Nov 14 03:39:21 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:21 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c
Nov 14 03:39:21 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:22 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484" returned: 0 in 0.475s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:22 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 is being set with open permissions: ugo+rw
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:22 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484
Nov 14 03:39:22 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:22 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c" returned: 0 in 0.553s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:22 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c
Nov 14 03:39:22 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:22 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484" returned: 0 in 0.437s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:22 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.info
Nov 14 03:39:22 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:22 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0c446ab1-f2af-4023-9993-25322b588d3c" returned: 0 in 0.450s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-0c446ab1-f2af-4023-9993-25322b588d3c" released by "delete_volume" :: held 1.023s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Created reservations ['de18327b-f741-4a66-8fa4-d69ca4c2876c', '65c39a28-6936-40ad-a4a3-2944101c2bd6', '85d4b015-1235-4876-8b16-e2d817d50384', 'd54ffb89-ea9d-4292-947b-e24c38a6419d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:22 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:22 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:22 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.info" returned: 0 in 0.497s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:22 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.info is being set with open permissions: ugo+rw
Nov 14 03:39:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:23 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.info
Nov 14 03:39:23 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:23 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.445s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Deleted volume successfully.
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-12854285-f071-4339-89c2-9db845deab63 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-0c446ab1-f2af-4023-9993-25322b588d3c-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:23 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.info" returned: 0 in 0.433s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2753fdfe-66a2-4c4f-88f3-d67d11757ad2 tempest-VolumeDependencyTests-2050111184 None] Create snapshot completed successfully
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-f009702a-4286-4c51-8eaf-e8f03b62a3ce-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-f009702a-4286-4c51-8eaf-e8f03b62a3ce-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:23 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-quobyte-f009702a-4286-4c51-8eaf-e8f03b62a3ce" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-f009702a-4286-4c51-8eaf-e8f03b62a3ce" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f80476-a5cf-427b-bdb2-160c5cac2e45]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:23 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce
Nov 14 03:39:23 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:24 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce" returned: 0 in 0.539s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:24 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce
Nov 14 03:39:24 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:24 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f009702a-4286-4c51-8eaf-e8f03b62a3ce" returned: 0 in 0.472s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-f009702a-4286-4c51-8eaf-e8f03b62a3ce" released by "delete_volume" :: held 1.049s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Created reservations ['23fea2f5-eaa9-452c-b31a-909d4461852c', '25b5ef8f-95c2-42b9-9853-d7b7e637755c', '8231a841-8098-4058-8c39-90011cec31b7', '88e853e7-e5c3-4e42-9e51-1df05e07474a'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:24 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:24 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:24 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Flow 'volume_create_manager' (6ff4e153-59f0-4aa6-bbbb-681a27d36b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77459285-f289-46c7-8eb9-8a6ea9040097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77459285-f289-46c7-8eb9-8a6ea9040097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-474186460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463ea5f0-079f-4491-94fb-05341bb82460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42056e50c9ed4dcb845eaf12d772fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=32e0a85d-4584-4ce5-9909-37e77deda484,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:25Z,use_quota=True,user_id='3e08b9970ee14bfc80aaf2e2ae756d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbbe2bc-685b-4964-9f4d-f4d5ee033fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbbe2bc-685b-4964-9f4d-f4d5ee033fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646a80b8-95bb-4e73-bc4c-d481412440a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646a80b8-95bb-4e73-bc4c-d481412440a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '463ea5f0-079f-4491-94fb-05341bb82460', 'volume_name': 'volume-463ea5f0-079f-4491-94fb-05341bb82460', 'volume_size': 1, 'snapshot_id': '32e0a85d-4584-4ce5-9909-37e77deda484'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699953e8-4837-43e0-afa2-8f3876d4a6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699953e8-4837-43e0-afa2-8f3876d4a6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e0dc82-3ddb-4661-835c-42e0ee2b75d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:24 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Volume 463ea5f0-079f-4491-94fb-05341bb82460: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-463ea5f0-079f-4491-94fb-05341bb82460', 'volume_size': 1, 'snapshot_id': '32e0a85d-4584-4ce5-9909-37e77deda484'}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-quobyte-32e0a85d-4584-4ce5-9909-37e77deda484-463ea5f0-079f-4491-94fb-05341bb82460" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-32e0a85d-4584-4ce5-9909-37e77deda484-463ea5f0-079f-4491-94fb-05341bb82460" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Creating volume 463ea5f0-079f-4491-94fb-05341bb82460 from snapshot 32e0a85d-4584-4ce5-9909-37e77deda484 {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-quobyte-463ea5f0-079f-4491-94fb-05341bb82460" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-463ea5f0-079f-4491-94fb-05341bb82460" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] snapshot: 32e0a85d-4584-4ce5-9909-37e77deda484, volume: 463ea5f0-079f-4491-94fb-05341bb82460,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed782941-0bae-4ceb-8341-4f30ec160379]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:25 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484
Nov 14 03:39:25 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:25 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.457s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:25 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Deleted volume successfully.
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2788051c-9f83-4563-9c18-aa18628fa830 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-f009702a-4286-4c51-8eaf-e8f03b62a3ce-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:25 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484" returned: 0 in 0.570s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d93de9c-a963-4f4d-805c-1173209e6d14]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:25 devstack sudo[100562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3
Nov 14 03:39:25 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-da9f8a79-554c-47e3-878c-ffb653367517-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-da9f8a79-554c-47e3-878c-ffb653367517-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-quobyte-da9f8a79-554c-47e3-878c-ffb653367517" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-da9f8a79-554c-47e3-878c-ffb653367517" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b592e75-7e20-4e97-8ca6-a358d245913a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:26 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517
Nov 14 03:39:26 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:26 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3" returned: 0 in 0.576s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:26 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460 not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:39:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:26 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460
Nov 14 03:39:26 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:26 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517" returned: 0 in 0.566s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:26 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517
Nov 14 03:39:26 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:28 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-da9f8a79-554c-47e3-878c-ffb653367517" returned: 0 in 1.632s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-da9f8a79-554c-47e3-878c-ffb653367517" released by "delete_volume" :: held 2.232s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=76,cinder:UPDATE=84,cinder:INSERT=15,cinder:DELETE=5 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=65,cinder:UPDATE=76,cinder:INSERT=17,cinder:DELETE=9 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Created reservations ['7eb7b7ff-6cf4-474e-9733-c76d67af1da4', '2d072214-1e15-4c61-836c-3dd4b3e4bf01', '0e7ed3be-7635-4bc4-8d78-9741d61d9b97', '7b6b7349-6090-44e2-9065-689cc7a58009'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:28 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460" returned: 0 in 2.076s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff34e5-09d9-4e5d-9b0a-1d19c20b7b97]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:28 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:28 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:28 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3
Nov 14 03:39:28 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:28 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.447s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:28 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Deleted volume successfully.
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f6486f32-6a21-4034-a01f-f197b9cce081 tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-da9f8a79-554c-47e3-878c-ffb653367517-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:28 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3" returned: 0 in 0.690s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:39:28 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Converted 1024.00 MB image at 492.89 MB/s
Nov 14 03:39:28 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460 is being set with open permissions: ugo+rw
Nov 14 03:39:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:28 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460
Nov 14 03:39:28 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-6760dae9-56ec-41cd-a61a-588d44f71333-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-6760dae9-56ec-41cd-a61a-588d44f71333-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:29 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "cinder-quobyte-6760dae9-56ec-41cd-a61a-588d44f71333" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-6760dae9-56ec-41cd-a61a-588d44f71333" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6d7ac8-2334-46fe-b761-2c85e00040ab]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:29 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460" returned: 0 in 0.458s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-463ea5f0-079f-4491-94fb-05341bb82460" released by "_copy_volume_from_snapshot" :: held 4.442s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-32e0a85d-4584-4ce5-9909-37e77deda484-463ea5f0-079f-4491-94fb-05341bb82460" released by "_create_volume_from_snapshot" :: held 4.460s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.471s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:29 devstack sudo[100600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333
Nov 14 03:39:29 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e0dc82-3ddb-4661-835c-42e0ee2b75d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463ea5f0-079f-4491-94fb-05341bb82460', 'volume_size': 1, 'snapshot_id': '32e0a85d-4584-4ce5-9909-37e77deda484'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9039a510-321f-4e4a-96d3-aefb88567c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:29 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Volume volume-463ea5f0-079f-4491-94fb-05341bb82460 (463ea5f0-079f-4491-94fb-05341bb82460): created successfully
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9039a510-321f-4e4a-96d3-aefb88567c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Flow 'volume_create_manager' (6ff4e153-59f0-4aa6-bbbb-681a27d36b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7cbe36a1-ea7f-4929-bafb-a6357dc2d63a tempest-VolumeDependencyTests-2050111184 None] Created volume successfully.
Nov 14 03:39:29 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333" returned: 0 in 0.557s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:29 devstack sudo[100606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333
Nov 14 03:39:29 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-32e0a85d-4584-4ce5-9909-37e77deda484-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-32e0a85d-4584-4ce5-9909-37e77deda484-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-quobyte-9e2f55f0-497e-40e9-8aa1-905738baf7d3" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-9e2f55f0-497e-40e9-8aa1-905738baf7d3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-quobyte-32e0a85d-4584-4ce5-9909-37e77deda484" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-32e0a85d-4584-4ce5-9909-37e77deda484" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Deleting offline snapshot 32e0a85d-4584-4ce5-9909-37e77deda484 of volume 9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:39:30 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] snapshot_file for this snap is: volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6760dae9-56ec-41cd-a61a-588d44f71333" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ebb6fa-c70a-4b23-be4e-eb46ae704572]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-quobyte-6760dae9-56ec-41cd-a61a-588d44f71333" released by "delete_volume" :: held 1.066s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Created reservations ['557b91ab-6d6a-462f-aed9-c77de7ff4332', 'f734447e-f735-4cf9-b273-4600429ffbc9', 'df15a6c4-a73a-44eb-9b7f-c3f4481c8b31', '3b0503e6-f986-45d5-ab5b-c62248240082'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:30 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:30 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:30 devstack sudo[100609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484
Nov 14 03:39:30 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:30 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484" returned: 0 in 0.525s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:39:30 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.450s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c62cb1-c98c-459c-9e9f-4eb314b1ce93]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:30 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Deleted volume successfully.
Nov 14 03:39:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ce097ef2-62b9-4c6a-9a69-68eab992e84b tempest-CreateVolumesFromImageTest-1693669573 None] Lock "cinder-6760dae9-56ec-41cd-a61a-588d44f71333-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:31 devstack sudo[100618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3
Nov 14 03:39:31 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:31 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3" returned: 0 in 0.544s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:31 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484
Nov 14 03:39:31 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:32 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:32 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484
Nov 14 03:39:32 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:32 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3.32e0a85d-4584-4ce5-9909-37e77deda484" returned: 0 in 0.493s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-32e0a85d-4584-4ce5-9909-37e77deda484" released by "_delete_snapshot" :: held 2.188s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-9e2f55f0-497e-40e9-8aa1-905738baf7d3" released by "delete_snapshot" :: held 2.204s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:32 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Created reservations ['47769a12-1865-465c-9437-980477825201', 'a00eddf3-4b42-4da2-b5bb-e8fdfcdf55fb', '341e7fa1-58f6-4e52-a1ff-843875d8da2e', '9d5b19fd-a7aa-4269-a6d2-1226163a0dd6'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:32 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Delete snapshot completed successfully.
Nov 14 03:39:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-79da3e9e-ba03-43da-ada4-fdc8b7ca2784 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-32e0a85d-4584-4ce5-9909-37e77deda484-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (989e43aa-6913-4b24-ac56-e3043a954f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0cab90-63f4-4d8d-9461-2abac5fee834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0cab90-63f4-4d8d-9461-2abac5fee834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1055865469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c525b1e-df04-46c8-abbc-e9e6256a8f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:33Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e456582-3bcc-4c70-8b27-b256897d7b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e456582-3bcc-4c70-8b27-b256897d7b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4815319-f51e-41a4-9f3d-68fe77bf7104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4815319-f51e-41a4-9f3d-68fe77bf7104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c525b1e-df04-46c8-abbc-e9e6256a8f2f', 'volume_name': 'volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c26978-f592-47fc-a11f-48d895ce227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c26978-f592-47fc-a11f-48d895ce227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db8fe04-cd01-45dc-803d-eeaaa9076052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:33 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume 3c525b1e-df04-46c8-abbc-e9e6256a8f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f', 'volume_size': 1}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1055865469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c525b1e-df04-46c8-abbc-e9e6256a8f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:33Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Creating volume 3c525b1e-df04-46c8-abbc-e9e6256a8f2f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:33 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:33 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f 1073741824
Nov 14 03:39:33 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-9e2f55f0-497e-40e9-8aa1-905738baf7d3-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-9e2f55f0-497e-40e9-8aa1-905738baf7d3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-quobyte-9e2f55f0-497e-40e9-8aa1-905738baf7d3" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-9e2f55f0-497e-40e9-8aa1-905738baf7d3" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34174c6-ee6a-4de4-8a03-ebe72452c6f8]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:33 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3
Nov 14 03:39:33 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:33 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f 1073741824" returned: 0 in 0.575s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:33 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f
Nov 14 03:39:33 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:34 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3" returned: 0 in 0.578s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:34 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3
Nov 14 03:39:34 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:34 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f" returned: 0 in 0.447s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db8fe04-cd01-45dc-803d-eeaaa9076052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc26a1f0-afd8-41d9-b499-d6a3fb9a0ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:34 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f (3c525b1e-df04-46c8-abbc-e9e6256a8f2f): created successfully
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc26a1f0-afd8-41d9-b499-d6a3fb9a0ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (989e43aa-6913-4b24-ac56-e3043a954f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:34 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-70c1df28-99a9-4480-a597-abd6ff774864 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created volume successfully.
Nov 14 03:39:34 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-9e2f55f0-497e-40e9-8aa1-905738baf7d3" returned: 0 in 0.474s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-9e2f55f0-497e-40e9-8aa1-905738baf7d3" released by "delete_volume" :: held 1.093s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Created reservations ['eeeaebec-d31b-46b1-8728-92f622dbc625', 'ab37f63c-6176-47bf-bdd9-0174f32a07f3', 'd0d98849-db32-470c-8817-8973ada1505e', '9858f637-271e-46c7-824f-d66251f375af'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:34 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:34 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:35 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.445s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:35 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Deleted volume successfully.
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df7efb0-4fd3-42da-9c7d-7999dad7bed0 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-9e2f55f0-497e-40e9-8aa1-905738baf7d3-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (d7985ab4-865c-435b-bb6b-37631da667ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31289ab8-fbfb-4c49-851c-fddad9432189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31289ab8-fbfb-4c49-851c-fddad9432189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-953170608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45051b9a-5062-4561-9529-5906fd3d43c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:35Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b532dd-ed61-44ac-85a1-3fdc0ee49c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b532dd-ed61-44ac-85a1-3fdc0ee49c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3303a57e-7753-457e-bb3a-b53388be85fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3303a57e-7753-457e-bb3a-b53388be85fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45051b9a-5062-4561-9529-5906fd3d43c5', 'volume_name': 'volume-45051b9a-5062-4561-9529-5906fd3d43c5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54eda5c1-ff57-41a0-93bf-52493235b4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54eda5c1-ff57-41a0-93bf-52493235b4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc8e251-71f4-4c04-83b2-7ed36d512138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume 45051b9a-5062-4561-9529-5906fd3d43c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45051b9a-5062-4561-9529-5906fd3d43c5', 'volume_size': 1}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-953170608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45051b9a-5062-4561-9529-5906fd3d43c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:35Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Creating volume 45051b9a-5062-4561-9529-5906fd3d43c5 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:35 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:35 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5 1073741824
Nov 14 03:39:35 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (c8c6b357-0836-4eef-8a99-affe8699d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104e82d8-401e-4a18-8230-5f36ddff218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104e82d8-401e-4a18-8230-5f36ddff218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011647040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:36Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6e1cbd-5c79-4a77-8acb-bc1db7890232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6e1cbd-5c79-4a77-8acb-bc1db7890232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117e801c-1e3f-40a3-9ea1-0d71bca4794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117e801c-1e3f-40a3-9ea1-0d71bca4794a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1', 'volume_name': 'volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd019418-0e1b-47f5-873a-5e36bd9c4419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd019418-0e1b-47f5-873a-5e36bd9c4419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126a6bea-6eae-4820-96b3-0a31173baf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume 05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1', 'volume_size': 1}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-463ea5f0-079f-4491-94fb-05341bb82460-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-463ea5f0-079f-4491-94fb-05341bb82460-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "cinder-quobyte-463ea5f0-079f-4491-94fb-05341bb82460" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (e2d12e19-daa0-4b2e-9029-e1226fff9c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89de2e2e-b925-4d52-a7c9-44da065b2ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89de2e2e-b925-4d52-a7c9-44da065b2ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-774244204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2f9ec1-7880-4541-af50-349ff68a9f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:36Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78d130d-8cc2-4227-a26e-60513cdd18e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78d130d-8cc2-4227-a26e-60513cdd18e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0cada60-950d-4916-94d1-1b309020e8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0cada60-950d-4916-94d1-1b309020e8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2f9ec1-7880-4541-af50-349ff68a9f29', 'volume_name': 'volume-3a2f9ec1-7880-4541-af50-349ff68a9f29', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8c64e6-9ccf-4bda-938b-3394aad35124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8c64e6-9ccf-4bda-938b-3394aad35124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fabdf30-c734-4878-bc9b-a3f93519ae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:35 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume 3a2f9ec1-7880-4541-af50-349ff68a9f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2f9ec1-7880-4541-af50-349ff68a9f29', 'volume_size': 1}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-463ea5f0-079f-4491-94fb-05341bb82460" acquired by "delete_volume" :: waited 0.107s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[170dbdcc-dd70-4b35-9618-55551303ba70]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:35 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:35 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (2609c946-b910-43c1-903c-99ac6d613bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4998e00-fe4d-40f1-b085-c627a1443b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4998e00-fe4d-40f1-b085-c627a1443b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1630956576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbf04bd-ee88-47a9-80a2-f828911d1066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:36Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b38f3c6-2a85-4b19-adcd-ff3d88b93f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b38f3c6-2a85-4b19-adcd-ff3d88b93f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c365ba8-c7f1-46b7-888d-237d8395f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c365ba8-c7f1-46b7-888d-237d8395f45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbf04bd-ee88-47a9-80a2-f828911d1066', 'volume_name': 'volume-0dbf04bd-ee88-47a9-80a2-f828911d1066', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ac4dc4-5f83-4957-8f90-05af60535cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ac4dc4-5f83-4957-8f90-05af60535cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ee7f2b-6c03-4355-a2d8-c4263f996d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume 0dbf04bd-ee88-47a9-80a2-f828911d1066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbf04bd-ee88-47a9-80a2-f828911d1066', 'volume_size': 1}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:36 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5 1073741824" returned: 0 in 0.609s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:36 devstack sudo[100657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460
Nov 14 03:39:36 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:36 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5
Nov 14 03:39:36 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:36 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (a383df91-0f84-4bd8-b588-cd20279a1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3338151a-f80d-4239-9e6d-53d8cedf1b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3338151a-f80d-4239-9e6d-53d8cedf1b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373296989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d9fc7d-fe57-46da-9216-f959021fe816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:36Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b22b46-8c89-4008-a79b-0f246345f074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b22b46-8c89-4008-a79b-0f246345f074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f001552-4559-4bfd-94ae-5cf5f2f8f1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f001552-4559-4bfd-94ae-5cf5f2f8f1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d9fc7d-fe57-46da-9216-f959021fe816', 'volume_name': 'volume-10d9fc7d-fe57-46da-9216-f959021fe816', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2785a3e1-3cd2-4fd9-bc16-1c262bad8200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2785a3e1-3cd2-4fd9-bc16-1c262bad8200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa1b9cc-89a4-4caf-bbac-6b46aa6cc496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume 10d9fc7d-fe57-46da-9216-f959021fe816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d9fc7d-fe57-46da-9216-f959021fe816', 'volume_size': 1}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:36 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5" returned: 0 in 0.453s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:36 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011647040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:36Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Creating volume 05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:36 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460" returned: 0 in 0.642s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:36 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1 1073741824
Nov 14 03:39:36 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc8e251-71f4-4c04-83b2-7ed36d512138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45051b9a-5062-4561-9529-5906fd3d43c5', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ee2e2b-3302-4270-9b44-a77d7fa271f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:36 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460
Nov 14 03:39:36 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:36 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume volume-45051b9a-5062-4561-9529-5906fd3d43c5 (45051b9a-5062-4561-9529-5906fd3d43c5): created successfully
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ee2e2b-3302-4270-9b44-a77d7fa271f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:36 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (d7985ab4-865c-435b-bb6b-37631da667ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:36 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8c37811a-5f9a-4cf3-b514-b35b01feaff7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created volume successfully.
Nov 14 03:39:37 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-463ea5f0-079f-4491-94fb-05341bb82460" returned: 0 in 0.482s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-quobyte-463ea5f0-079f-4491-94fb-05341bb82460" released by "delete_volume" :: held 1.158s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Created reservations ['21053982-2401-411a-b957-80d29eb1bb0e', '010674a1-578f-4ad2-9b7a-44905e1c893b', 'f4c61fbe-21d6-4386-a684-bcc1a0101925', '40b4de3f-3813-4a5a-85b1-74db1d3943a6'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:37 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1 1073741824" returned: 0 in 0.560s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:37 devstack sudo[100673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1
Nov 14 03:39:37 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:37 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:37 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:37 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1" returned: 0 in 0.424s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-774244204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2f9ec1-7880-4541-af50-349ff68a9f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:36Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Creating volume 3a2f9ec1-7880-4541-af50-349ff68a9f29 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:37 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:37 devstack sudo[100679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29 1073741824
Nov 14 03:39:37 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126a6bea-6eae-4820-96b3-0a31173baf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2aab16-ab5a-4f13-941d-cb879ff21505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:37 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1 (05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1): created successfully
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2aab16-ab5a-4f13-941d-cb879ff21505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (c8c6b357-0836-4eef-8a99-affe8699d607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:37 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1d5aacbc-9168-46c6-a49a-7b090b8ccdd7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created volume successfully.
Nov 14 03:39:37 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.465s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:37 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Deleted volume successfully.
Nov 14 03:39:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9ca4595e-c81f-4f8b-8135-3b1fd43d1783 tempest-VolumeDependencyTests-2050111184 None] Lock "cinder-463ea5f0-079f-4491-94fb-05341bb82460-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:38 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29 1073741824" returned: 0 in 0.588s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:38 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29
Nov 14 03:39:38 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:38 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29" returned: 0 in 0.536s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.622s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1630956576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbf04bd-ee88-47a9-80a2-f828911d1066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:36Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Creating volume 0dbf04bd-ee88-47a9-80a2-f828911d1066 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:38 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fabdf30-c734-4878-bc9b-a3f93519ae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2f9ec1-7880-4541-af50-349ff68a9f29', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:38 devstack sudo[100687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066 1073741824
Nov 14 03:39:38 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f1575-4343-4dc0-8264-5fd6350c67f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:38 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume volume-3a2f9ec1-7880-4541-af50-349ff68a9f29 (3a2f9ec1-7880-4541-af50-349ff68a9f29): created successfully
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f1575-4343-4dc0-8264-5fd6350c67f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:38 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (e2d12e19-daa0-4b2e-9029-e1226fff9c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:38 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a79c6ba4-6d0b-4f70-b700-cebb3352db82 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created volume successfully.
Nov 14 03:39:39 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066 1073741824" returned: 0 in 0.562s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:39 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066
Nov 14 03:39:39 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:39 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Flow 'volume_create_manager' (13bdc16f-a525-4291-bdc7-47c3b7e4e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f9bf43-5cce-43d7-938d-210c4b30b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f9bf43-5cce-43d7-938d-210c4b30b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a6e9f1-174d-44df-bf53-a84407f171df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83335a4197a3437493ff063407cdf2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:40Z,use_quota=True,user_id='e1d32f32f6d3495c8ea2489e24d4adc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb5c71f-606f-438e-8715-5b4b297beecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb5c71f-606f-438e-8715-5b4b297beecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46ceed2-7648-4982-bfa2-99af74c426b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46ceed2-7648-4982-bfa2-99af74c426b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a6e9f1-174d-44df-bf53-a84407f171df', 'volume_name': 'volume-88a6e9f1-174d-44df-bf53-a84407f171df', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c32205-d357-4ff5-953e-ac1f59b85965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c32205-d357-4ff5-953e-ac1f59b85965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a2bf65-d0d1-49f4-b679-f37b66fc7ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:39 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Volume 88a6e9f1-174d-44df-bf53-a84407f171df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a6e9f1-174d-44df-bf53-a84407f171df', 'volume_size': 1}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:39 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066" returned: 0 in 0.464s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.476s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373296989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d9fc7d-fe57-46da-9216-f959021fe816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95c6b6463a4c46bd30ab0cbff80ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:36Z,use_quota=True,user_id='93e710039eb44c7cb11104a9fd4ec0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Creating volume 10d9fc7d-fe57-46da-9216-f959021fe816 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:39 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ee7f2b-6c03-4355-a2d8-c4263f996d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbf04bd-ee88-47a9-80a2-f828911d1066', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:39 devstack sudo[100695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816 1073741824
Nov 14 03:39:39 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ab0588-9aaf-47fb-b079-4a5c0f7f8793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:39 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume volume-0dbf04bd-ee88-47a9-80a2-f828911d1066 (0dbf04bd-ee88-47a9-80a2-f828911d1066): created successfully
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ab0588-9aaf-47fb-b079-4a5c0f7f8793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:39 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (2609c946-b910-43c1-903c-99ac6d613bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:39 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-aa520605-4baf-4a68-b7dd-b1208343444e tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created volume successfully.
Nov 14 03:39:40 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816 1073741824" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:40 devstack sudo[100700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816
Nov 14 03:39:40 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:40 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816" returned: 0 in 0.430s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a6e9f1-174d-44df-bf53-a84407f171df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83335a4197a3437493ff063407cdf2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:40Z,use_quota=True,user_id='e1d32f32f6d3495c8ea2489e24d4adc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Creating volume 88a6e9f1-174d-44df-bf53-a84407f171df {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:40 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa1b9cc-89a4-4caf-bbac-6b46aa6cc496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d9fc7d-fe57-46da-9216-f959021fe816', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4bdc87-dc9b-412f-aa42-aa90b2a1bf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:40 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df 1073741824
Nov 14 03:39:40 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:40 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume volume-10d9fc7d-fe57-46da-9216-f959021fe816 (10d9fc7d-fe57-46da-9216-f959021fe816): created successfully
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4bdc87-dc9b-412f-aa42-aa90b2a1bf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Flow 'volume_create_manager' (a383df91-0f84-4bd8-b588-cd20279a1927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:40 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ed589caf-3d3c-4e2d-836f-2377ac509ae7 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created volume successfully.
Nov 14 03:39:41 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df 1073741824" returned: 0 in 0.551s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:41 devstack sudo[100709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df
Nov 14 03:39:41 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-10d9fc7d-fe57-46da-9216-f959021fe816-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-10d9fc7d-fe57-46da-9216-f959021fe816-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-quobyte-10d9fc7d-fe57-46da-9216-f959021fe816" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-10d9fc7d-fe57-46da-9216-f959021fe816" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5748bc41-18ac-417d-8c21-641e5e1ec8f2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:41 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df" returned: 0 in 0.472s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a2bf65-d0d1-49f4-b679-f37b66fc7ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a6e9f1-174d-44df-bf53-a84407f171df', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b308694e-24e4-4026-ba29-1d21cfd21fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Volume volume-88a6e9f1-174d-44df-bf53-a84407f171df (88a6e9f1-174d-44df-bf53-a84407f171df): created successfully
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b308694e-24e4-4026-ba29-1d21cfd21fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Flow 'volume_create_manager' (13bdc16f-a525-4291-bdc7-47c3b7e4e90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:41 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1387abee-22ac-4e53-8cba-4f3d36d77c65 tempest-CinderUnicodeTest-1641503199 None] Created volume successfully.
Nov 14 03:39:41 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816
Nov 14 03:39:41 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:42 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816" returned: 0 in 0.529s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:42 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816
Nov 14 03:39:42 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:42 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-10d9fc7d-fe57-46da-9216-f959021fe816" returned: 0 in 0.438s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-10d9fc7d-fe57-46da-9216-f959021fe816" released by "delete_volume" :: held 1.000s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created reservations ['6375da5c-3843-4851-9721-8e0ad272c03b', '9369dc81-b4a7-4d83-9deb-ad4cc50f2746', 'c7a38ba9-94b9-4901-8711-36c94c93c9a6', 'bac99997-9e1e-4e19-8a09-61ba7f99a2f4'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:42 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:42 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:42 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:39:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Flow 'volume_create_manager' (61d78ecf-0e56-46c1-853a-8bd86e86840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077555ad-dcbd-4abb-889d-e45500fe3345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077555ad-dcbd-4abb-889d-e45500fe3345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-915852814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921d57cc-5815-47ba-840a-5a3070109d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83335a4197a3437493ff063407cdf2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:43Z,use_quota=True,user_id='e1d32f32f6d3495c8ea2489e24d4adc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cb879e-364e-4c6f-ac4f-e8872ce9fb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cb879e-364e-4c6f-ac4f-e8872ce9fb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34125e1-6b9a-47eb-bd9e-684c5ec8d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34125e1-6b9a-47eb-bd9e-684c5ec8d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921d57cc-5815-47ba-840a-5a3070109d6a', 'volume_name': 'volume-921d57cc-5815-47ba-840a-5a3070109d6a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe04b0f-24c1-419b-8919-5fc58f592313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe04b0f-24c1-419b-8919-5fc58f592313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996e6c6d-000d-4c21-a141-346c57ba67b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:43 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Volume 921d57cc-5815-47ba-840a-5a3070109d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921d57cc-5815-47ba-840a-5a3070109d6a', 'volume_size': 1}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:39:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-915852814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921d57cc-5815-47ba-840a-5a3070109d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83335a4197a3437493ff063407cdf2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:39:43Z,use_quota=True,user_id='e1d32f32f6d3495c8ea2489e24d4adc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Creating volume 921d57cc-5815-47ba-840a-5a3070109d6a {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:39:43 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:43 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a 1073741824
Nov 14 03:39:43 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:43 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.444s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:43 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Deleted volume successfully.
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f2aa3335-ee78-4086-94af-f957ae3b2b01 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-10d9fc7d-fe57-46da-9216-f959021fe816-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:43 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a 1073741824" returned: 0 in 0.531s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:43 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a
Nov 14 03:39:43 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-0dbf04bd-ee88-47a9-80a2-f828911d1066-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-0dbf04bd-ee88-47a9-80a2-f828911d1066-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:43 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-quobyte-0dbf04bd-ee88-47a9-80a2-f828911d1066" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-0dbf04bd-ee88-47a9-80a2-f828911d1066" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4066cac-da13-4e7c-a674-94690ca9cc7e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:43 devstack sudo[100730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066
Nov 14 03:39:43 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:44 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996e6c6d-000d-4c21-a141-346c57ba67b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921d57cc-5815-47ba-840a-5a3070109d6a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27723c95-9433-42c6-8ac6-007d0184953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:39:44 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Volume volume-921d57cc-5815-47ba-840a-5a3070109d6a (921d57cc-5815-47ba-840a-5a3070109d6a): created successfully
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27723c95-9433-42c6-8ac6-007d0184953f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Flow 'volume_create_manager' (61d78ecf-0e56-46c1-853a-8bd86e86840c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:39:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2e700ef5-5e93-4bf1-88f1-ae125a3d8203 tempest-CinderUnicodeTest-1641503199 None] Created volume successfully.
Nov 14 03:39:44 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:44 devstack sudo[100738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066
Nov 14 03:39:44 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:44 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-0dbf04bd-ee88-47a9-80a2-f828911d1066" returned: 0 in 0.436s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-0dbf04bd-ee88-47a9-80a2-f828911d1066" released by "delete_volume" :: held 1.029s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created reservations ['cae7e55f-ba41-4e3f-be5b-2f6522c9f6d6', 'f8d60f7c-da1c-4cdf-a5e7-fe183b8f76d8', '14f0c75f-93fb-4f9f-b90f-14a57fc4d880', '2955434e-f737-4c32-9a5a-4846708c56ea'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:44 devstack sudo[100741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:44 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Creating offline snapshot e4e77639-ceda-4c46-8194-41e7293ee8b2 of volume 921d57cc-5815-47ba-840a-5a3070109d6a {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8b37b8-7971-4527-b7fe-902dff97aad9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:45 devstack sudo[100743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a
Nov 14 03:39:45 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:45 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.462s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Deleted volume successfully.
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8cf239d9-026b-4be9-b3d6-b88c3d73e2e8 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-0dbf04bd-ee88-47a9-80a2-f828911d1066-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:45 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a" returned: 0 in 0.545s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:45 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 1G
Nov 14 03:39:45 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:45 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-3a2f9ec1-7880-4541-af50-349ff68a9f29-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-3a2f9ec1-7880-4541-af50-349ff68a9f29-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:46 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-quobyte-3a2f9ec1-7880-4541-af50-349ff68a9f29" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-3a2f9ec1-7880-4541-af50-349ff68a9f29" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37d3e8d-8fa8-476c-afc9-3b18f22d2b2a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:46 devstack sudo[100751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29
Nov 14 03:39:46 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:46 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 1G" returned: 0 in 0.519s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921d57cc-5815-47ba-840a-5a3070109d6a -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:46 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921d57cc-5815-47ba-840a-5a3070109d6a -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2
Nov 14 03:39:46 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:46 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29" returned: 0 in 0.575s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:46 devstack sudo[100761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29
Nov 14 03:39:46 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:46 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921d57cc-5815-47ba-840a-5a3070109d6a -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2" returned: 0 in 0.472s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:46 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 is being set with open permissions: ugo+rw
Nov 14 03:39:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:46 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2
Nov 14 03:39:46 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:47 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3a2f9ec1-7880-4541-af50-349ff68a9f29" returned: 0 in 0.478s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-3a2f9ec1-7880-4541-af50-349ff68a9f29" released by "delete_volume" :: held 1.086s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created reservations ['64f08f6f-0fcb-43cf-a91b-9751366e4000', '40fa1aba-d005-455d-99ad-c7d3ae1e1002', 'f21fb331-fefe-4e41-a48f-606f668e4c44', 'e64a7819-d735-4d9b-ad45-5bed0450f937'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:47 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:47 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2" returned: 0 in 0.448s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:47 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:47 devstack sudo[100772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.info
Nov 14 03:39:47 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:47 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:47 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.461s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.info" returned: 0 in 0.441s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:47 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.info is being set with open permissions: ugo+rw
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:47 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Deleted volume successfully.
Nov 14 03:39:47 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.info
Nov 14 03:39:47 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:47 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-818d988a-456b-4ad4-b4ef-fd8b20015687 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-3a2f9ec1-7880-4541-af50-349ff68a9f29-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:48 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.info" returned: 0 in 0.452s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.912s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:48 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1221583d-2edc-43b4-9604-c02b09105ce5 tempest-CinderUnicodeTest-1641503199 None] Create snapshot completed successfully
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-quobyte-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1d828b-0052-4e7b-a14e-ee34da0f0249]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "cinder-e4e77639-ceda-4c46-8194-41e7293ee8b2-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-e4e77639-ceda-4c46-8194-41e7293ee8b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:48 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:48 devstack sudo[100779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "cinder-quobyte-921d57cc-5815-47ba-840a-5a3070109d6a" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:48 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-quobyte-921d57cc-5815-47ba-840a-5a3070109d6a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "cinder-quobyte-e4e77639-ceda-4c46-8194-41e7293ee8b2" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-quobyte-e4e77639-ceda-4c46-8194-41e7293ee8b2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Deleting offline snapshot e4e77639-ceda-4c46-8194-41e7293ee8b2 of volume 921d57cc-5815-47ba-840a-5a3070109d6a {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] snapshot_file for this snap is: volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d9707e-1583-4667-bfa7-0ce82531e023]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:48 devstack sudo[100781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2
Nov 14 03:39:48 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:48 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1" returned: 0 in 0.575s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:48 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1
Nov 14 03:39:48 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:48 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2" returned: 0 in 0.560s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921d57cc-5815-47ba-840a-5a3070109d6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b319c50-3caf-476b-b468-97ccf499be4d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:49 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a
Nov 14 03:39:49 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:49 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1" returned: 0 in 0.450s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1" released by "delete_volume" :: held 1.055s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created reservations ['4c095899-49b2-4de4-afd7-c0228fb7cc9a', 'a72d388b-e40f-4f76-b29e-317c52ae1857', 'a704029a-026a-4c60-b0b0-94562138955e', '1aaf3f19-001a-4123-afff-c176154f76e4'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:49 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:49 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:49 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a" returned: 0 in 0.549s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:49 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2
Nov 14 03:39:49 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:49 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.455s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:49 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Deleted volume successfully.
Nov 14 03:39:49 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9d510bfe-4bcd-4acf-b0ea-a6222a8a7907 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-05b6ce76-e930-4d7b-a3d9-4c2616d3cdf1-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:50 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2" returned: 0 in 0.479s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:50 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2
Nov 14 03:39:50 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-45051b9a-5062-4561-9529-5906fd3d43c5-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-45051b9a-5062-4561-9529-5906fd3d43c5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:50 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-quobyte-45051b9a-5062-4561-9529-5906fd3d43c5" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-45051b9a-5062-4561-9529-5906fd3d43c5" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d391e4-e3d8-46d4-ba04-2be92faa9feb]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:50 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a.e4e77639-ceda-4c46-8194-41e7293ee8b2" returned: 0 in 0.460s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-quobyte-e4e77639-ceda-4c46-8194-41e7293ee8b2" released by "_delete_snapshot" :: held 2.114s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-quobyte-921d57cc-5815-47ba-840a-5a3070109d6a" released by "delete_snapshot" :: held 2.125s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Created reservations ['5da20d18-4186-451a-9235-7ed60dad8a96', '3d67c0ec-bda0-4143-9902-ad5e5eb461a2', '5775db7b-7e29-4852-9997-ce0693566bc2', '53c03c1d-f25a-400c-b360-9f1e7cf9cae6'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:50 devstack sudo[100808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5
Nov 14 03:39:50 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:50 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Delete snapshot completed successfully.
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e078a17c-a390-421f-9385-ce0f819ae0ab tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-e4e77639-ceda-4c46-8194-41e7293ee8b2-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:50 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5" returned: 0 in 0.551s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:50 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5
Nov 14 03:39:50 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:51 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-45051b9a-5062-4561-9529-5906fd3d43c5" returned: 0 in 0.428s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-45051b9a-5062-4561-9529-5906fd3d43c5" released by "delete_volume" :: held 1.014s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created reservations ['552fe572-3b2f-4943-b00f-3a33a36be526', '11b6662b-36f8-4468-a11d-691063dbcae8', '0489c91d-7e99-4b7c-a935-5ea1994d98cd', '28ba6e9a-0f7e-4ea1-adb9-fee3a59355c1'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:51 devstack sudo[100817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:51 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "cinder-921d57cc-5815-47ba-840a-5a3070109d6a-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-921d57cc-5815-47ba-840a-5a3070109d6a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:51 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "cinder-quobyte-921d57cc-5815-47ba-840a-5a3070109d6a" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-quobyte-921d57cc-5815-47ba-840a-5a3070109d6a" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1488739-4ac6-4a41-b647-10fdf413fb23]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:51 devstack sudo[100819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a
Nov 14 03:39:51 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:51 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.472s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:51 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Deleted volume successfully.
Nov 14 03:39:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7df045eb-5352-4b96-9fac-50149931e9d6 tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-45051b9a-5062-4561-9529-5906fd3d43c5-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:52 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:52 devstack sudo[100825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a
Nov 14 03:39:52 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-3c525b1e-df04-46c8-abbc-e9e6256a8f2f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-3c525b1e-df04-46c8-abbc-e9e6256a8f2f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "cinder-quobyte-3c525b1e-df04-46c8-abbc-e9e6256a8f2f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:52 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-921d57cc-5815-47ba-840a-5a3070109d6a" returned: 0 in 0.457s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-3c525b1e-df04-46c8-abbc-e9e6256a8f2f" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-quobyte-921d57cc-5815-47ba-840a-5a3070109d6a" released by "delete_volume" :: held 1.042s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f05e2-5d14-4373-8130-c73a9cb95f55]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Created reservations ['575ce3b9-cac3-495e-a4bd-626267489ebb', 'e82a836d-312d-41b4-a03e-495b9ef7a425', '1bc5f97d-d375-4b7d-915d-052dd89b9660', '0b65a756-6832-4d26-90e2-592c8ed14071'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:52 devstack sudo[100829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:52 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:52 devstack sudo[100828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f
Nov 14 03:39:52 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:53 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.430s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:53 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Deleted volume successfully.
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a66e9480-2849-4d8a-87f8-f66b2d225802 tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-921d57cc-5815-47ba-840a-5a3070109d6a-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:53 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f" returned: 0 in 0.579s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:53 devstack sudo[100836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f
Nov 14 03:39:53 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:53 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-3c525b1e-df04-46c8-abbc-e9e6256a8f2f" returned: 0 in 0.451s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-quobyte-3c525b1e-df04-46c8-abbc-e9e6256a8f2f" released by "delete_volume" :: held 1.061s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Created reservations ['499085d0-221a-4c53-b4bf-1190b4cd254b', '8488d99c-c825-454d-8ec5-dfd1d2cdf36a', '68e4b6a5-b5c5-49d9-aa7f-5ee05671763c', '88650d34-fe91-40d3-ad44-733110b53481'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "cinder-88a6e9f1-174d-44df-bf53-a84407f171df-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-88a6e9f1-174d-44df-bf53-a84407f171df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:53 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "cinder-quobyte-88a6e9f1-174d-44df-bf53-a84407f171df" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-quobyte-88a6e9f1-174d-44df-bf53-a84407f171df" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa45efb1-02f8-471c-9062-83545c182c0a]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:53 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:53 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:53 devstack sudo[100839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df
Nov 14 03:39:53 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:54 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:54 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:54 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.439s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:54 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Deleted volume successfully.
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-acb4d300-bc54-4664-a11e-6227070477ea tempest-CreateVolumesFromSourceVolumeTest-1776840340 None] Lock "cinder-3c525b1e-df04-46c8-abbc-e9e6256a8f2f-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:54 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df" returned: 0 in 0.546s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:54 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df
Nov 14 03:39:54 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:54 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.436s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:54 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-88a6e9f1-174d-44df-bf53-a84407f171df" returned: 0 in 0.495s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-quobyte-88a6e9f1-174d-44df-bf53-a84407f171df" released by "delete_volume" :: held 1.069s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Created reservations ['a10123bd-a059-45cd-8d5a-8441fa4e71d6', 'ca977c7b-cc14-47b7-98bd-d7191fc2d219', '39a33aff-6028-4758-9fb9-946354c680cf', '08cdebcc-464d-4b63-8a1c-c962abbeb930'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:39:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:39:54 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:39:54 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:39:55 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Nov 14 03:39:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.502s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:39:55 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:39:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Deleted volume successfully.
Nov 14 03:39:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ea583c5a-ee21-4760-b086-23548b6c2e0b tempest-CinderUnicodeTest-1641503199 None] Lock "cinder-88a6e9f1-174d-44df-bf53-a84407f171df-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:04 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=74,cinder:INSERT=29,cinder:UPDATE=131,cinder:DELETE=12 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:40:08 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=81,cinder:INSERT=27,cinder:UPDATE=120,cinder:DELETE=10 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:40:09 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Flow 'volume_create_manager' (b2487269-0ea1-48e1-bef5-f0cf159bf714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbc54bb-a455-4803-8ac8-3f8d82e26c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbc54bb-a455-4803-8ac8-3f8d82e26c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1503271088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a208489-9fab-4cd0-842b-4b68e3c4fadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6e4ed967584488b05ceb8ca1fe4440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:10Z,use_quota=True,user_id='18d108161d584111ae692ac4d45438d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75839494-50e0-442d-ae1c-0876a96879d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75839494-50e0-442d-ae1c-0876a96879d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98c638f-dbee-49ff-a1e1-9ae02b2e6340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98c638f-dbee-49ff-a1e1-9ae02b2e6340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a208489-9fab-4cd0-842b-4b68e3c4fadf', 'volume_name': 'volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525fd866-0f77-4f73-a415-0b78ceedb831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525fd866-0f77-4f73-a415-0b78ceedb831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f4e357-a31d-4305-8958-71888336afea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:09 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Volume 7a208489-9fab-4cd0-842b-4b68e3c4fadf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf', 'volume_size': 1}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1503271088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a208489-9fab-4cd0-842b-4b68e3c4fadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6e4ed967584488b05ceb8ca1fe4440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:10Z,use_quota=True,user_id='18d108161d584111ae692ac4d45438d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Creating volume 7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:09 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:40:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:09 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf 1073741824
Nov 14 03:40:09 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:10 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf 1073741824" returned: 0 in 0.551s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:10 devstack sudo[100864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf
Nov 14 03:40:10 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:10 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf" returned: 0 in 0.458s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f4e357-a31d-4305-8958-71888336afea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75aaf277-9b3c-4018-a8bd-9ea59675a959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:10 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Volume volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf (7a208489-9fab-4cd0-842b-4b68e3c4fadf): created successfully
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75aaf277-9b3c-4018-a8bd-9ea59675a959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:10 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Flow 'volume_create_manager' (b2487269-0ea1-48e1-bef5-f0cf159bf714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8eb2e9ae-5e94-4db8-af2c-79c35ba9e8c8 tempest-SnapshotDependencyTests-1201446343 None] Created volume successfully.
Nov 14 03:40:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Creating offline snapshot 62c423ac-6c57-44b3-af6b-0f84f29976e9 of volume 7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:40:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3695245f-16c1-4ea9-8cca-421cc9c1ff8f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:12 devstack sudo[100868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf
Nov 14 03:40:12 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:12 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:12 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 1G
Nov 14 03:40:12 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:13 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 1G" returned: 0 in 0.502s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:13 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9
Nov 14 03:40:13 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:13 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9" returned: 0 in 0.468s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:13 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 is being set with open permissions: ugo+rw
Nov 14 03:40:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:13 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9
Nov 14 03:40:13 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:13 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9" returned: 0 in 0.427s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:14 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.info
Nov 14 03:40:14 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:14 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.info" returned: 0 in 0.442s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:14 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.info is being set with open permissions: ugo+rw
Nov 14 03:40:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:14 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.info
Nov 14 03:40:14 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:14 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.info" returned: 0 in 0.424s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:14 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-99b2e754-e76a-4b2c-ae88-12a8a737c6fd tempest-SnapshotDependencyTests-1201446343 None] Create snapshot completed successfully
Nov 14 03:40:15 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Flow 'volume_create_manager' (68646d59-49cc-43ba-b699-ea60f3190b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48a8b85-9b12-4150-abb6-14982baeacb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48a8b85-9b12-4150-abb6-14982baeacb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b27869-5d51-44da-b192-913a9ca943f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6e4ed967584488b05ceb8ca1fe4440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=62c423ac-6c57-44b3-af6b-0f84f29976e9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:15Z,use_quota=True,user_id='18d108161d584111ae692ac4d45438d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8357bc-753b-40b3-900f-882aa640a7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8357bc-753b-40b3-900f-882aa640a7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bd2c5e-85d3-4547-b399-96491bca4a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bd2c5e-85d3-4547-b399-96491bca4a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3b27869-5d51-44da-b192-913a9ca943f8', 'volume_name': 'volume-c3b27869-5d51-44da-b192-913a9ca943f8', 'volume_size': 1, 'snapshot_id': '62c423ac-6c57-44b3-af6b-0f84f29976e9'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1bf463-07be-4d95-a20a-e0deaa812321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1bf463-07be-4d95-a20a-e0deaa812321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25edf18a-37cf-4f99-83b8-44cbe502091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:15 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Volume c3b27869-5d51-44da-b192-913a9ca943f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3b27869-5d51-44da-b192-913a9ca943f8', 'volume_size': 1, 'snapshot_id': '62c423ac-6c57-44b3-af6b-0f84f29976e9'}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-quobyte-62c423ac-6c57-44b3-af6b-0f84f29976e9-c3b27869-5d51-44da-b192-913a9ca943f8" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-62c423ac-6c57-44b3-af6b-0f84f29976e9-c3b27869-5d51-44da-b192-913a9ca943f8" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Creating volume c3b27869-5d51-44da-b192-913a9ca943f8 from snapshot 62c423ac-6c57-44b3-af6b-0f84f29976e9 {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-quobyte-c3b27869-5d51-44da-b192-913a9ca943f8" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-c3b27869-5d51-44da-b192-913a9ca943f8" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] snapshot: 62c423ac-6c57-44b3-af6b-0f84f29976e9, volume: c3b27869-5d51-44da-b192-913a9ca943f8,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[01397afd-a6e8-4093-bc8a-c4753c09eaac]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:15 devstack sudo[100893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9
Nov 14 03:40:15 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:16 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9" returned: 0 in 0.540s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4a158-0b21-4af1-9742-2282c53171c4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:16 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf
Nov 14 03:40:16 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:16 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf" returned: 0 in 0.543s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8 not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:40:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:16 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8
Nov 14 03:40:16 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:18 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8" returned: 0 in 2.079s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e4c74-2d9c-4259-81fa-ab2fdbce2f78]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:18 devstack sudo[100916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf
Nov 14 03:40:18 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:19 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf" returned: 0 in 0.661s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:40:19 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Converted 1024.00 MB image at 492.23 MB/s
Nov 14 03:40:19 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8 is being set with open permissions: ugo+rw
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:19 devstack sudo[100921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8
Nov 14 03:40:19 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:19 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8" returned: 0 in 0.435s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-c3b27869-5d51-44da-b192-913a9ca943f8" released by "_copy_volume_from_snapshot" :: held 4.317s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-62c423ac-6c57-44b3-af6b-0f84f29976e9-c3b27869-5d51-44da-b192-913a9ca943f8" released by "_create_volume_from_snapshot" :: held 4.331s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.344s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25edf18a-37cf-4f99-83b8-44cbe502091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b27869-5d51-44da-b192-913a9ca943f8', 'volume_size': 1, 'snapshot_id': '62c423ac-6c57-44b3-af6b-0f84f29976e9'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56407eba-f6ef-4dee-a6a0-a798e7293e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Volume volume-c3b27869-5d51-44da-b192-913a9ca943f8 (c3b27869-5d51-44da-b192-913a9ca943f8): created successfully
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56407eba-f6ef-4dee-a6a0-a798e7293e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Flow 'volume_create_manager' (68646d59-49cc-43ba-b699-ea60f3190b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-a3623b72-1b7c-4657-8b48-137c85dd027a tempest-SnapshotDependencyTests-1201446343 None] Created volume successfully.
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-62c423ac-6c57-44b3-af6b-0f84f29976e9-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-62c423ac-6c57-44b3-af6b-0f84f29976e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-quobyte-7a208489-9fab-4cd0-842b-4b68e3c4fadf" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-7a208489-9fab-4cd0-842b-4b68e3c4fadf" acquired by "delete_snapshot" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-quobyte-62c423ac-6c57-44b3-af6b-0f84f29976e9" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-62c423ac-6c57-44b3-af6b-0f84f29976e9" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Deleting offline snapshot 62c423ac-6c57-44b3-af6b-0f84f29976e9 of volume 7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] snapshot_file for this snap is: volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[84734e02-4ea6-497a-b60b-48a792e7cc83]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:20 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9
Nov 14 03:40:20 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:21 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9" returned: 0 in 0.525s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:40:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5945e3b7-c573-41b2-b3ee-54eeb790ed12]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:21 devstack sudo[100930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf
Nov 14 03:40:21 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:21 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:21 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9
Nov 14 03:40:21 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:22 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9" returned: 0 in 0.462s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:22 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9
Nov 14 03:40:22 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:22 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf.62c423ac-6c57-44b3-af6b-0f84f29976e9" returned: 0 in 0.428s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-62c423ac-6c57-44b3-af6b-0f84f29976e9" released by "_delete_snapshot" :: held 2.011s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-7a208489-9fab-4cd0-842b-4b68e3c4fadf" released by "delete_snapshot" :: held 2.022s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:22 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Created reservations ['025eb08c-f778-4f5f-9315-f403cbe7e221', '81c245dd-492e-4ca1-a77e-81f2ead40777', '86a38c9e-1679-4f48-ad4a-8f62070cdd4c', '3ecb54ef-c536-42c6-a8b4-6a88840f8f3c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:40:22 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Delete snapshot completed successfully.
Nov 14 03:40:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8a905609-889a-48d9-a1a1-acc740de73c6 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-62c423ac-6c57-44b3-af6b-0f84f29976e9-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-7a208489-9fab-4cd0-842b-4b68e3c4fadf-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-7a208489-9fab-4cd0-842b-4b68e3c4fadf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:23 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-quobyte-7a208489-9fab-4cd0-842b-4b68e3c4fadf" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-7a208489-9fab-4cd0-842b-4b68e3c4fadf" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:23 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ea0a0b-4374-4ec6-a9f8-68cfd9a725e3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:24 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf
Nov 14 03:40:24 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:24 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf" returned: 0 in 0.562s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:24 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf
Nov 14 03:40:24 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:24 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-7a208489-9fab-4cd0-842b-4b68e3c4fadf" returned: 0 in 0.440s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-7a208489-9fab-4cd0-842b-4b68e3c4fadf" released by "delete_volume" :: held 1.043s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Created reservations ['aeaceb6f-2a00-427e-9e1c-e4dcc7b53db7', 'ec9cfbb0-38ee-4e85-b78a-8d60b8c5ac9f', '2cf2dd3b-be8d-43ae-b363-d12eb3dbce00', 'e052d762-6d30-4443-ac36-6074d0f5bd73'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:25 devstack sudo[100985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:40:25 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:25 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.418s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:40:25 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Deleted volume successfully.
Nov 14 03:40:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-39c79da0-ca86-4e67-904c-cc5727d5fd54 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-7a208489-9fab-4cd0-842b-4b68e3c4fadf-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-c3b27869-5d51-44da-b192-913a9ca943f8-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-c3b27869-5d51-44da-b192-913a9ca943f8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:26 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "cinder-quobyte-c3b27869-5d51-44da-b192-913a9ca943f8" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-c3b27869-5d51-44da-b192-913a9ca943f8" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:26 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8127276-dd41-40f8-b5c6-409447847b63]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:26 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8
Nov 14 03:40:26 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:26 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8" returned: 0 in 0.542s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:26 devstack sudo[100999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8
Nov 14 03:40:26 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:27 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-c3b27869-5d51-44da-b192-913a9ca943f8" returned: 0 in 0.444s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-quobyte-c3b27869-5d51-44da-b192-913a9ca943f8" released by "delete_volume" :: held 1.016s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Created reservations ['c7ec4d50-9159-4ff5-846f-d686d14674c8', '8d77a0a9-6556-4f40-9d40-4012f4b937fd', '3df04ab0-1f85-49f2-87bd-766cd9b589db', '2db24aeb-d835-4dcc-914c-8392a5312ff6'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:27 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:40:27 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:27 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.418s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:40:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Deleted volume successfully.
Nov 14 03:40:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-7e6c549b-d132-4b9b-92c1-008dce06e1f1 tempest-SnapshotDependencyTests-1201446343 None] Lock "cinder-c3b27869-5d51-44da-b192-913a9ca943f8-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:37 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=19,cinder:DELETE=2,cinder:UPDATE=24,cinder:INSERT=10 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:40:37 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=29,cinder:SELECT=20,cinder:DELETE=3,cinder:INSERT=2 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:40:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (657959c8-e142-42cd-a1fc-c198067f738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33e448a-7208-4694-84a4-85a3f28873e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33e448a-7208-4694-84a4-85a3f28873e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2021432819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2a5398-5851-4459-96f7-c81666be9e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe22837c-8a85-4a2b-bbb9-5d7da75af783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe22837c-8a85-4a2b-bbb9-5d7da75af783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694a0e70-1a54-49b0-a4f2-283d15f6ad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694a0e70-1a54-49b0-a4f2-283d15f6ad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2a5398-5851-4459-96f7-c81666be9e86', 'volume_name': 'volume-6b2a5398-5851-4459-96f7-c81666be9e86', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5ce804-7ad7-4b17-ae80-cc7d4ee67169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5ce804-7ad7-4b17-ae80-cc7d4ee67169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef91be89-8436-40dc-b320-3f7cb2e4f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Volume 6b2a5398-5851-4459-96f7-c81666be9e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2a5398-5851-4459-96f7-c81666be9e86', 'volume_size': 1}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2021432819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2a5398-5851-4459-96f7-c81666be9e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Creating volume 6b2a5398-5851-4459-96f7-c81666be9e86 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:40 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:40 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86 1073741824
Nov 14 03:40:40 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:40 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Flow 'volume_create_manager' (102987ea-13cf-464c-a404-f689851d0440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0baff2e-683a-49bc-a5f5-002cefe14836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0baff2e-683a-49bc-a5f5-002cefe14836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1523412138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9a9ed9-a344-4aeb-8638-4b39ec095932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693aa2b53fd54dfa83a8a3119221e7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='37004b2c9b704f87b11e4e918093cbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92efcae-38c2-45a9-a44a-b038cc40133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92efcae-38c2-45a9-a44a-b038cc40133c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304e5f5b-6913-4f89-889d-d52f488c2cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304e5f5b-6913-4f89-889d-d52f488c2cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9a9ed9-a344-4aeb-8638-4b39ec095932', 'volume_name': 'volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a8de2-6717-40c0-8ed8-e0f8b78d2d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a8de2-6717-40c0-8ed8-e0f8b78d2d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f84d938-73d4-4fde-ad8f-53356ffee1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:40 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Volume fe9a9ed9-a344-4aeb-8638-4b39ec095932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932', 'volume_size': 1}
Nov 14 03:40:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (c8fd5646-b21d-4008-9886-297a766b9455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5912e5ae-7adb-49c1-9fd9-111f24eacf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5912e5ae-7adb-49c1-9fd9-111f24eacf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1084097930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd795498-9586-4cd7-b3fd-521f5d81e0b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457be7ab-ae2f-41d0-9365-c8b2e52cd2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457be7ab-ae2f-41d0-9365-c8b2e52cd2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d91f59-b926-4d51-8ab8-99637700a872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d91f59-b926-4d51-8ab8-99637700a872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd795498-9586-4cd7-b3fd-521f5d81e0b9', 'volume_name': 'volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3427eb04-5548-45b6-82a7-ef787d857b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3427eb04-5548-45b6-82a7-ef787d857b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3df4ff-5c49-468d-a00a-74d89839dabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume cd795498-9586-4cd7-b3fd-521f5d81e0b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9', 'volume_size': 1}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (93e5b240-0a2c-44d8-8bb0-3fed1ce898f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8504c2ef-6529-4b48-962f-19c44c19a478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8504c2ef-6529-4b48-962f-19c44c19a478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-590094973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0945952-adb5-496d-a02a-9ffb8d21b2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c134fc-2a47-4f4c-a2f1-60329419cf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c134fc-2a47-4f4c-a2f1-60329419cf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3f47df-624c-4478-ab86-b48c236bb6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3f47df-624c-4478-ab86-b48c236bb6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0945952-adb5-496d-a02a-9ffb8d21b2cc', 'volume_name': 'volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f0ce09-dc89-42ec-aab4-192f3995940d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f0ce09-dc89-42ec-aab4-192f3995940d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e21c3d-8f2c-4ce7-824d-8db377166494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Volume e0945952-adb5-496d-a02a-9ffb8d21b2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc', 'volume_size': 1}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (cb286383-82e3-4658-9b1d-a08575cb47ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28eb51d-4862-4501-8fe4-c6fb88cc647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28eb51d-4862-4501-8fe4-c6fb88cc647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155017355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26eb938-ed77-4c02-a752-97a22ed6914f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cccb3f-2712-4d7a-81d3-f695376fd22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cccb3f-2712-4d7a-81d3-f695376fd22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cba4a2c-00ab-4fe1-a5a4-253dd64e7df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cba4a2c-00ab-4fe1-a5a4-253dd64e7df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26eb938-ed77-4c02-a752-97a22ed6914f', 'volume_name': 'volume-e26eb938-ed77-4c02-a752-97a22ed6914f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93133de4-95a3-4538-b027-3be95ef4ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93133de4-95a3-4538-b027-3be95ef4ac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33f00e4-f04e-45bd-9c04-95ffa54fe7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Volume e26eb938-ed77-4c02-a752-97a22ed6914f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26eb938-ed77-4c02-a752-97a22ed6914f', 'volume_size': 1}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (fbba2bc3-7def-4d0a-9960-9705e72f4803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6748a-e3cc-47af-841e-3f002ffc4f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6748a-e3cc-47af-841e-3f002ffc4f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-287926642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d0da05-d8f5-4982-b58d-249ef6c9a317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b91952-d5e2-4373-bf43-56d222c209c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b91952-d5e2-4373-bf43-56d222c209c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed886d87-e2d2-4e47-a267-11ed45d7bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed886d87-e2d2-4e47-a267-11ed45d7bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d0da05-d8f5-4982-b58d-249ef6c9a317', 'volume_name': 'volume-66d0da05-d8f5-4982-b58d-249ef6c9a317', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0734037-b7d8-4a61-b83a-2c408d11f8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0734037-b7d8-4a61-b83a-2c408d11f8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb93bdf-c367-4435-82bd-4a23e6e068c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Volume 66d0da05-d8f5-4982-b58d-249ef6c9a317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d0da05-d8f5-4982-b58d-249ef6c9a317', 'volume_size': 1}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:41 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (85fd1380-50e9-49ed-96ea-61e92bf36352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530eef7c-1772-47b9-984d-53fe9bac6b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530eef7c-1772-47b9-984d-53fe9bac6b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1803965317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d4a2b9-d35f-49a5-a418-5b768f94e4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ab5b69-ed60-40ff-82e2-b0ba2f8d767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ab5b69-ed60-40ff-82e2-b0ba2f8d767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b517e643-adef-4142-94f8-8d35f43269c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b517e643-adef-4142-94f8-8d35f43269c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d4a2b9-d35f-49a5-a418-5b768f94e4bc', 'volume_name': 'volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08edfb1-17ef-4f85-a6dc-aca6b6e7f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08edfb1-17ef-4f85-a6dc-aca6b6e7f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25317f9f-d6aa-4c11-956d-db30f0ea05c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:41 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Volume 81d4a2b9-d35f-49a5-a418-5b768f94e4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc', 'volume_size': 1}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:41 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86 1073741824" returned: 0 in 0.953s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:41 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:41 devstack sudo[101068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86
Nov 14 03:40:41 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:42 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86" returned: 0 in 0.501s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.231s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1523412138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9a9ed9-a344-4aeb-8638-4b39ec095932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693aa2b53fd54dfa83a8a3119221e7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='37004b2c9b704f87b11e4e918093cbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Creating volume fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:42 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef91be89-8436-40dc-b320-3f7cb2e4f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2a5398-5851-4459-96f7-c81666be9e86', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dea1c0-47ab-4cfe-955e-b2adaf4677a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:42 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 1073741824
Nov 14 03:40:42 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:42 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Volume volume-6b2a5398-5851-4459-96f7-c81666be9e86 (6b2a5398-5851-4459-96f7-c81666be9e86): created successfully
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dea1c0-47ab-4cfe-955e-b2adaf4677a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (657959c8-e142-42cd-a1fc-c198067f738a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:42 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b7f4ac85-822c-44ab-bb62-397542888afb tempest-CreateVolumesFromImageTest-236642293 None] Created volume successfully.
Nov 14 03:40:42 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 1073741824" returned: 0 in 0.565s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:42 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:42 devstack sudo[101076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932
Nov 14 03:40:42 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:43 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932" returned: 0 in 0.497s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1084097930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd795498-9586-4cd7-b3fd-521f5d81e0b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Creating volume cd795498-9586-4cd7-b3fd-521f5d81e0b9 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:43 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f84d938-73d4-4fde-ad8f-53356ffee1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a9499c-a91a-4d56-b6da-1e423e04c139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:43 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 1073741824
Nov 14 03:40:43 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:43 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Volume volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 (fe9a9ed9-a344-4aeb-8638-4b39ec095932): created successfully
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a9499c-a91a-4d56-b6da-1e423e04c139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Flow 'volume_create_manager' (102987ea-13cf-464c-a404-f689851d0440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:43 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-59c68a0f-23ab-437d-b22f-d99c181a8254 tempest-VolumeDependencyTests-5250879 None] Created volume successfully.
Nov 14 03:40:43 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 1073741824" returned: 0 in 0.619s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:43 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:43 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9
Nov 14 03:40:43 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:44 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:44 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.282s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-590094973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0945952-adb5-496d-a02a-9ffb8d21b2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Creating volume e0945952-adb5-496d-a02a-9ffb8d21b2cc {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:44 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3df4ff-5c49-468d-a00a-74d89839dabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea0dab0-df91-408e-947f-f64958060a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:44 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc 1073741824
Nov 14 03:40:44 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:44 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 (cd795498-9586-4cd7-b3fd-521f5d81e0b9): created successfully
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea0dab0-df91-408e-947f-f64958060a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:44 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (c8fd5646-b21d-4008-9886-297a766b9455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:44 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4a8fa28c-5eb9-439e-871b-bf90195f77e7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Created volume successfully.
Nov 14 03:40:45 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc 1073741824" returned: 0 in 0.630s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:45 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc
Nov 14 03:40:45 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:45 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:45 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc" returned: 0 in 0.579s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.430s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155017355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26eb938-ed77-4c02-a752-97a22ed6914f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Creating volume e26eb938-ed77-4c02-a752-97a22ed6914f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:45 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e21c3d-8f2c-4ce7-824d-8db377166494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fb5040-a25e-4c99-b3c7-aa2e96402011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:45 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f 1073741824
Nov 14 03:40:45 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:45 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Volume volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc (e0945952-adb5-496d-a02a-9ffb8d21b2cc): created successfully
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fb5040-a25e-4c99-b3c7-aa2e96402011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:45 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (93e5b240-0a2c-44d8-8bb0-3fed1ce898f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:45 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-34945424-40b4-4003-bb09-00ab2ce82b5b tempest-CreateVolumesFromImageTest-236642293 None] Created volume successfully.
Nov 14 03:40:46 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f 1073741824" returned: 0 in 0.712s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:46 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f
Nov 14 03:40:46 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:46 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f" returned: 0 in 0.493s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.420s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-287926642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d0da05-d8f5-4982-b58d-249ef6c9a317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Creating volume 66d0da05-d8f5-4982-b58d-249ef6c9a317 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:46 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33f00e4-f04e-45bd-9c04-95ffa54fe7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26eb938-ed77-4c02-a752-97a22ed6914f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65df084e-ad46-4436-9380-c11b27171479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:46 devstack sudo[101105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317 1073741824
Nov 14 03:40:46 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:46 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Volume volume-e26eb938-ed77-4c02-a752-97a22ed6914f (e26eb938-ed77-4c02-a752-97a22ed6914f): created successfully
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65df084e-ad46-4436-9380-c11b27171479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:46 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (cb286383-82e3-4658-9b1d-a08575cb47ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:46 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-5b8ff1a7-b968-4052-91ff-f1878920d90b tempest-CreateVolumesFromImageTest-236642293 None] Created volume successfully.
Nov 14 03:40:47 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317 1073741824" returned: 0 in 0.631s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:47 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:47 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317
Nov 14 03:40:47 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:48 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317" returned: 0 in 0.517s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.473s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1803965317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d4a2b9-d35f-49a5-a418-5b768f94e4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcb4312f243a79aae2c3332cd8d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:41Z,use_quota=True,user_id='d073271a1f4a41eca748e8e6c17f2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Creating volume 81d4a2b9-d35f-49a5-a418-5b768f94e4bc {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:48 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb93bdf-c367-4435-82bd-4a23e6e068c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d0da05-d8f5-4982-b58d-249ef6c9a317', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:48 devstack sudo[101113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc 1073741824
Nov 14 03:40:48 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca1009-3316-40be-bef0-c29720133d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:48 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Volume volume-66d0da05-d8f5-4982-b58d-249ef6c9a317 (66d0da05-d8f5-4982-b58d-249ef6c9a317): created successfully
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca1009-3316-40be-bef0-c29720133d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (fbba2bc3-7def-4d0a-9960-9705e72f4803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:48 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-37a88340-ae97-45b5-9980-fbdc58285661 tempest-CreateVolumesFromImageTest-236642293 None] Created volume successfully.
Nov 14 03:40:48 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc 1073741824" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:48 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:48 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc
Nov 14 03:40:48 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:49 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc" returned: 0 in 0.480s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.982s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25317f9f-d6aa-4c11-956d-db30f0ea05c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca6025f-f6e8-43de-b5b4-905a68238eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:49 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Volume volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc (81d4a2b9-d35f-49a5-a418-5b768f94e4bc): created successfully
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca6025f-f6e8-43de-b5b4-905a68238eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Flow 'volume_create_manager' (85fd1380-50e9-49ed-96ea-61e92bf36352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Creating offline snapshot 7bec342d-65f1-451d-918f-810aa0f339da of volume fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:40:49 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-163a568b-d4f2-4776-b821-38b05d887139 tempest-CreateVolumesFromImageTest-236642293 None] Created volume successfully.
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be83172-2de1-4779-9799-05659616a642]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:49 devstack sudo[101121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932
Nov 14 03:40:49 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:49 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932" returned: 0 in 0.623s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:49 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:49 devstack sudo[101126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da 1G
Nov 14 03:40:49 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-81d4a2b9-d35f-49a5-a418-5b768f94e4bc-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-81d4a2b9-d35f-49a5-a418-5b768f94e4bc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:50 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-quobyte-81d4a2b9-d35f-49a5-a418-5b768f94e4bc" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-81d4a2b9-d35f-49a5-a418-5b768f94e4bc" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[24551bd0-eb49-44e1-9f93-32adccd2bfe2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:50 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da 1G" returned: 0 in 0.591s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:50 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da
Nov 14 03:40:50 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:50 devstack sudo[101131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc
Nov 14 03:40:50 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:50 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da" returned: 0 in 0.536s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:50 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da is being set with open permissions: ugo+rw
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:50 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc" returned: 0 in 0.623s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:50 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:50 devstack sudo[101142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da
Nov 14 03:40:50 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:50 devstack sudo[101143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc
Nov 14 03:40:50 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:51 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da" returned: 0 in 0.514s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:51 devstack sudo[101148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.info
Nov 14 03:40:51 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:51 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-81d4a2b9-d35f-49a5-a418-5b768f94e4bc" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-81d4a2b9-d35f-49a5-a418-5b768f94e4bc" released by "delete_volume" :: held 1.199s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Created reservations ['892d35dd-b06e-4d04-8781-81b03e71d94d', '99cd74b0-8559-447e-873b-9b9fede11774', '176d9be5-26c5-4b2d-8923-fdec3a471f53', '7a37db93-36ec-4fc5-b3f1-9307895d6094'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:51 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:51 devstack sudo[101150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:40:51 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:52 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.info" returned: 0 in 0.543s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:52 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.info is being set with open permissions: ugo+rw
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:52 devstack sudo[101153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.info
Nov 14 03:40:52 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:52 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.562s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:40:52 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Deleted volume successfully.
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ad32929-e127-4d33-b6a8-11e51568b5ee tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-81d4a2b9-d35f-49a5-a418-5b768f94e4bc-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:52 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-66d0da05-d8f5-4982-b58d-249ef6c9a317-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.info" returned: 0 in 0.482s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.365s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.207s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Creating offline snapshot b5d455a1-9b17-4c6a-8610-38ea7fbdd30b of volume cd795498-9586-4cd7-b3fd-521f5d81e0b9 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-66d0da05-d8f5-4982-b58d-249ef6c9a317-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f31ad24-24a5-4c03-9284-e3ca69d18315]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:52 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-1a0d4156-d8ff-4a61-8608-e76a3d411c13 tempest-VolumeDependencyTests-5250879 None] Create snapshot completed successfully
Nov 14 03:40:52 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-quobyte-66d0da05-d8f5-4982-b58d-249ef6c9a317" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-66d0da05-d8f5-4982-b58d-249ef6c9a317" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[951b15df-950b-4051-a65f-7d5afc0524b9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:52 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:52 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9
Nov 14 03:40:52 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:52 devstack sudo[101158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317
Nov 14 03:40:52 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:53 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9" returned: 0 in 0.615s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:53 devstack sudo[101167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b 1G
Nov 14 03:40:53 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:53 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317" returned: 0 in 0.653s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:53 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317
Nov 14 03:40:53 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:53 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-66d0da05-d8f5-4982-b58d-249ef6c9a317" returned: 0 in 0.509s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-66d0da05-d8f5-4982-b58d-249ef6c9a317" released by "delete_volume" :: held 1.185s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:53 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b 1G" returned: 0 in 0.639s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:53 devstack sudo[101175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b
Nov 14 03:40:53 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:53 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Created reservations ['208ba762-ef62-4c85-a492-a5702ca98bfa', 'b626fbcd-17fe-47b0-ada5-95b72698ffd0', '370de535-5ec9-4229-a31e-e3d19e7691e3', 'ee9a2ec6-96f6-4dd6-9e15-586664e2c4a6'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Flow 'volume_create_manager' (cac2ba12-0b9e-410f-b52d-65ebb0e9748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf2a898-a185-4c8c-82e4-5291218a78ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf2a898-a185-4c8c-82e4-5291218a78ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-451222341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de638fd5-0c42-4e5b-93ca-c08156c1a15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693aa2b53fd54dfa83a8a3119221e7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7bec342d-65f1-451d-918f-810aa0f339da,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:54Z,use_quota=True,user_id='37004b2c9b704f87b11e4e918093cbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca233d1-624b-4bdd-9647-5a109909f41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca233d1-624b-4bdd-9647-5a109909f41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0938b24e-9523-4162-94dc-6e9c79f1be62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0938b24e-9523-4162-94dc-6e9c79f1be62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de638fd5-0c42-4e5b-93ca-c08156c1a15f', 'volume_name': 'volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f', 'volume_size': 1, 'snapshot_id': '7bec342d-65f1-451d-918f-810aa0f339da'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80141ce8-8f2b-438c-8f07-f1f01f3d8595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80141ce8-8f2b-438c-8f07-f1f01f3d8595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d4046f-2b12-4606-a119-3cb3dbd42176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:53 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Volume de638fd5-0c42-4e5b-93ca-c08156c1a15f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f', 'volume_size': 1, 'snapshot_id': '7bec342d-65f1-451d-918f-810aa0f339da'}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:53 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:53 devstack sudo[101177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:40:53 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_service.periodic_task [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80846) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:54 devstack sudo[101179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:40:54 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:54 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b" returned: 0 in 0.532s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:54 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b is being set with open permissions: ugo+rw
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:54 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b
Nov 14 03:40:54 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:54 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.483s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:40:54 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Deleted volume successfully.
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-9a062c1e-8e4d-4de2-b09a-599c79827212 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-66d0da05-d8f5-4982-b58d-249ef6c9a317-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-e26eb938-ed77-4c02-a752-97a22ed6914f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-e26eb938-ed77-4c02-a752-97a22ed6914f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:54 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.647s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-53f40d6b-21dc-4691-a4b4-a855ed76b09a None None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:40:54 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-quobyte-e26eb938-ed77-4c02-a752-97a22ed6914f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-e26eb938-ed77-4c02-a752-97a22ed6914f" acquired by "delete_volume" :: waited 0.026s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a1133a-34b8-4fe9-a002-43915fe0e8e6]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:54 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b" returned: 0 in 0.591s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:54 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:54 devstack sudo[101190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.info
Nov 14 03:40:54 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:55 devstack sudo[101189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f
Nov 14 03:40:55 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:55 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.info" returned: 0 in 0.477s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:55 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.info is being set with open permissions: ugo+rw
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:55 devstack sudo[101194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.info
Nov 14 03:40:55 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:55 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f" returned: 0 in 0.638s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:55 devstack sudo[101199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f
Nov 14 03:40:55 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:55 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Flow 'volume_create_manager' (c3c5937d-3f02-487c-b334-4c2b39dcd089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572622ad-fa5d-4260-813d-dbc0f65543de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572622ad-fa5d-4260-813d-dbc0f65543de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-640228142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67f332c-3d06-45c4-a2e7-af9e0b915e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e801a3934c744a6993a7cc4d9a024d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:56Z,use_quota=True,user_id='dd6722d1c8e64265a00738dea4f47b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75967ae-93dc-440a-bb8c-866f84bc8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75967ae-93dc-440a-bb8c-866f84bc8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b48f7b-3c1a-4820-bac4-fc5136b0de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b48f7b-3c1a-4820-bac4-fc5136b0de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67f332c-3d06-45c4-a2e7-af9e0b915e21', 'volume_name': 'volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc4d245-21af-4c3d-bc7c-bda7773ac5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc4d245-21af-4c3d-bc7c-bda7773ac5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0555e8a7-ac3c-472a-b7ce-0b66d2c3bf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:55 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Volume f67f332c-3d06-45c4-a2e7-af9e0b915e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21', 'volume_size': 1}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:55 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.info" returned: 0 in 0.489s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.397s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.999s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-quobyte-7bec342d-65f1-451d-918f-810aa0f339da-de638fd5-0c42-4e5b-93ca-c08156c1a15f" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:55 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4495b87b-f74d-461c-872a-d74cfbd93fda tempest-CreateVolumesFromSnapshotTest-937662215 None] Create snapshot completed successfully
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-7bec342d-65f1-451d-918f-810aa0f339da-de638fd5-0c42-4e5b-93ca-c08156c1a15f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Creating volume de638fd5-0c42-4e5b-93ca-c08156c1a15f from snapshot 7bec342d-65f1-451d-918f-810aa0f339da {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-quobyte-de638fd5-0c42-4e5b-93ca-c08156c1a15f" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-de638fd5-0c42-4e5b-93ca-c08156c1a15f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] snapshot: 7bec342d-65f1-451d-918f-810aa0f339da, volume: de638fd5-0c42-4e5b-93ca-c08156c1a15f,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb4f569-b279-4afa-bc53-01e1bb70f387]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:55 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:56 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e26eb938-ed77-4c02-a752-97a22ed6914f" returned: 0 in 0.486s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-e26eb938-ed77-4c02-a752-97a22ed6914f" released by "delete_volume" :: held 1.149s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Created reservations ['b7b15f4e-76cd-45c3-a3a5-099145520914', '03bee59e-341a-48ee-a050-21f1d1803579', 'a5554850-a2cd-4780-8574-6cbe5a133db6', '2c4a7691-4bfb-4b73-907e-0aab0413b2ad'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:56 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da
Nov 14 03:40:56 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:56 devstack sudo[101204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:40:56 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:56 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:56 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.437s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da" returned: 0 in 0.559s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:40:56 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Deleted volume successfully.
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5febde3a-1493-480b-b751-65a170c0106d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ebd1fe08-d34d-455e-8b36-cbab90533402 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-e26eb938-ed77-4c02-a752-97a22ed6914f-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:56 devstack sudo[101211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932
Nov 14 03:40:56 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (a8c894d8-7167-41ef-afc0-3c334175d35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91707cd7-05bf-47e5-b264-ef8d07d6d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91707cd7-05bf-47e5-b264-ef8d07d6d327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986364111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387517ec-818a-4d63-9e37-3164bb8148cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:57Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf48b6c7-3103-4703-b027-05e430485913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf48b6c7-3103-4703-b027-05e430485913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e45291a-8eed-4679-adbc-4ab4e0909470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e45291a-8eed-4679-adbc-4ab4e0909470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387517ec-818a-4d63-9e37-3164bb8148cd', 'volume_name': 'volume-387517ec-818a-4d63-9e37-3164bb8148cd', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3526391f-6f1b-4bae-91bd-bba9011b4854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3526391f-6f1b-4bae-91bd-bba9011b4854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52988760-9c15-4691-949d-6b029317258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:56 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume 387517ec-818a-4d63-9e37-3164bb8148cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387517ec-818a-4d63-9e37-3164bb8148cd', 'volume_size': 1}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-e0945952-adb5-496d-a02a-9ffb8d21b2cc-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-e0945952-adb5-496d-a02a-9ffb8d21b2cc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:56 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-quobyte-e0945952-adb5-496d-a02a-9ffb8d21b2cc" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-e0945952-adb5-496d-a02a-9ffb8d21b2cc" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[458752e2-a51d-419f-ad4b-cf68d8f19281]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:56 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (9d77bbe3-0f8f-489a-b5fc-e0a1c8640b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082c9526-af3f-4623-bb79-de0c842bf035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082c9526-af3f-4623-bb79-de0c842bf035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1641004280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ab5871-2a06-47be-9fd2-c6137fe4141f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:57Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe36223c-a817-44fb-9073-a07924a45fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe36223c-a817-44fb-9073-a07924a45fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca03ac09-3f81-4416-a6c6-e904e976d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca03ac09-3f81-4416-a6c6-e904e976d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06ab5871-2a06-47be-9fd2-c6137fe4141f', 'volume_name': 'volume-06ab5871-2a06-47be-9fd2-c6137fe4141f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a2a33e-919b-408a-9bfa-5d51bcd690a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack sudo[101213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc
Nov 14 03:40:57 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a2a33e-919b-408a-9bfa-5d51bcd690a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9939b1de-cb1f-47b9-99c2-88230d8bfbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume 06ab5871-2a06-47be-9fd2-c6137fe4141f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06ab5871-2a06-47be-9fd2-c6137fe4141f', 'volume_size': 1}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:57 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932" returned: 0 in 0.708s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:57 devstack sudo[101218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f
Nov 14 03:40:57 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (1a9b10d0-cffc-4c9f-bf8f-98ea737bc7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e44248-ef26-483a-a1f5-d3246ca0fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e44248-ef26-483a-a1f5-d3246ca0fd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1383910393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218b1778-13d2-47b0-ae57-83f59ba01e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:57Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e77ad49-13e8-4aa8-b78e-c5b8aa68abf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e77ad49-13e8-4aa8-b78e-c5b8aa68abf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388b1e60-ab0c-42b4-b414-12d2af91eb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388b1e60-ab0c-42b4-b414-12d2af91eb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218b1778-13d2-47b0-ae57-83f59ba01e53', 'volume_name': 'volume-218b1778-13d2-47b0-ae57-83f59ba01e53', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c4e7d1-b070-44c6-843e-9f5c4dc1ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c4e7d1-b070-44c6-843e-9f5c4dc1ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85138001-64db-4b23-9014-f56ce3c68acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume 218b1778-13d2-47b0-ae57-83f59ba01e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218b1778-13d2-47b0-ae57-83f59ba01e53', 'volume_size': 1}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (a79591de-e0eb-4417-8c17-760756a45964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d689ee-6d6d-4428-a82f-68b96c3e5920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d689ee-6d6d-4428-a82f-68b96c3e5920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754259564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:57Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b99df6c-35c8-49a6-bf1c-cc9ab1312d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b99df6c-35c8-49a6-bf1c-cc9ab1312d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077bb684-3108-4f4c-b434-5805505e8866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077bb684-3108-4f4c-b434-5805505e8866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc', 'volume_name': 'volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e217289f-aef9-4ab9-9e97-ef8022b1823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e217289f-aef9-4ab9-9e97-ef8022b1823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cf2d21-147a-452f-827a-de63f42c52ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc', 'volume_size': 1}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:57 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc" returned: 0 in 0.652s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:57 devstack sudo[101223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc
Nov 14 03:40:57 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:57 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (70ddff78-313f-45a9-b5c5-5deb89053dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa558f3-db7b-4112-94ab-8c98095ce1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa558f3-db7b-4112-94ab-8c98095ce1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1890963803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cc30b6-b127-4c33-979a-e0b7c8b4991a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:58Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee13660-10ed-451f-be5e-d74cad71ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee13660-10ed-451f-be5e-d74cad71ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81264871-2e87-4f37-803e-75554c5070c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81264871-2e87-4f37-803e-75554c5070c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4cc30b6-b127-4c33-979a-e0b7c8b4991a', 'volume_name': 'volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5998ce1a-d1c3-40c8-ba0f-d668b681296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5998ce1a-d1c3-40c8-ba0f-d668b681296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0885f249-86c3-4fc9-8968-d9bffd9fe3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:40:57 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume e4cc30b6-b127-4c33-979a-e0b7c8b4991a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a', 'volume_size': 1}
Nov 14 03:40:57 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:58 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e0945952-adb5-496d-a02a-9ffb8d21b2cc" returned: 0 in 0.971s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-e0945952-adb5-496d-a02a-9ffb8d21b2cc" released by "delete_volume" :: held 1.656s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Created reservations ['351d5b09-b42f-44b3-89e5-ee502d62b7f3', 'cf9c0c2c-845c-482b-ba69-04317682d7c7', 'b0c7d450-ba3e-4344-97f2-9ec6156e56f4', '747fb44a-cd9a-4f8f-ac4a-c71a2d33b705'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:40:58 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:58 devstack sudo[101237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:40:58 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-6b2a5398-5851-4459-96f7-c81666be9e86-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-6b2a5398-5851-4459-96f7-c81666be9e86-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:59 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "cinder-quobyte-6b2a5398-5851-4459-96f7-c81666be9e86" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-6b2a5398-5851-4459-96f7-c81666be9e86" acquired by "delete_volume" :: waited 0.042s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9718fcb-d151-40a1-b62f-642108b5066b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:59 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f" returned: 0 in 2.386s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25b75e-0844-4572-af46-50f18b7e33de]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:40:59 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86
Nov 14 03:40:59 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:59 devstack sudo[101240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932
Nov 14 03:40:59 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:40:59 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.935s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:40:59 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Deleted volume successfully.
Nov 14 03:40:59 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-06835a10-769e-405c-9ead-17884e97c528 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-e0945952-adb5-496d-a02a-9ffb8d21b2cc-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:00 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86" returned: 0 in 0.587s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:00 devstack sudo[101249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86
Nov 14 03:41:00 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:00 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932" returned: 0 in 0.664s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:41:00 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Converted 1024.00 MB image at 428.72 MB/s
Nov 14 03:41:00 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f is being set with open permissions: ugo+rw
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:00 devstack sudo[101252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f
Nov 14 03:41:00 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:00 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-6b2a5398-5851-4459-96f7-c81666be9e86" returned: 0 in 0.478s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-quobyte-6b2a5398-5851-4459-96f7-c81666be9e86" released by "delete_volume" :: held 1.125s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Created reservations ['e4843e27-f474-4ff5-9988-5ac43afb329c', 'ede0f11a-07d7-4fc6-8d75-14b4dd139c6c', '33183e01-e1cc-4f69-83ba-674d476216b4', '5b0676d3-a3c2-4240-9e37-4ff5bb3c6581'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:00 devstack sudo[101256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:00 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:00 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f" returned: 0 in 0.460s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-de638fd5-0c42-4e5b-93ca-c08156c1a15f" released by "_copy_volume_from_snapshot" :: held 4.837s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-7bec342d-65f1-451d-918f-810aa0f339da-de638fd5-0c42-4e5b-93ca-c08156c1a15f" released by "_create_volume_from_snapshot" :: held 4.854s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.873s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.126s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-640228142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67f332c-3d06-45c4-a2e7-af9e0b915e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e801a3934c744a6993a7cc4d9a024d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:56Z,use_quota=True,user_id='dd6722d1c8e64265a00738dea4f47b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Creating volume f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:00 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:00 devstack sudo[101259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 1073741824
Nov 14 03:41:00 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d4046f-2b12-4606-a119-3cb3dbd42176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f', 'volume_size': 1, 'snapshot_id': '7bec342d-65f1-451d-918f-810aa0f339da'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd35bc4-0426-45a0-96ba-eef604259009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:00 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Volume volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f (de638fd5-0c42-4e5b-93ca-c08156c1a15f): created successfully
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd35bc4-0426-45a0-96ba-eef604259009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:00 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Flow 'volume_create_manager' (cac2ba12-0b9e-410f-b52d-65ebb0e9748d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:00 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-829cf854-5f84-4add-93fe-94255a8c3a11 tempest-VolumeDependencyTests-5250879 None] Created volume successfully.
Nov 14 03:41:01 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.513s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Deleted volume successfully.
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-3ca8dbea-5d31-434b-93cb-054bf7bd3ec7 tempest-CreateVolumesFromImageTest-236642293 None] Lock "cinder-6b2a5398-5851-4459-96f7-c81666be9e86-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:01 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 1073741824" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:01 devstack sudo[101265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21
Nov 14 03:41:01 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-7bec342d-65f1-451d-918f-810aa0f339da-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-7bec342d-65f1-451d-918f-810aa0f339da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:01 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-quobyte-fe9a9ed9-a344-4aeb-8638-4b39ec095932" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-fe9a9ed9-a344-4aeb-8638-4b39ec095932" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-quobyte-7bec342d-65f1-451d-918f-810aa0f339da" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-7bec342d-65f1-451d-918f-810aa0f339da" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Deleting offline snapshot 7bec342d-65f1-451d-918f-810aa0f339da of volume fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] snapshot_file for this snap is: volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3127f7e4-b125-4e8f-9a59-ecae87362d63]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:01 devstack sudo[101267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da
Nov 14 03:41:01 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:01 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21" returned: 0 in 0.535s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.966s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986364111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387517ec-818a-4d63-9e37-3164bb8148cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:57Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Creating volume 387517ec-818a-4d63-9e37-3164bb8148cd {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:01 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:01 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd 1073741824
Nov 14 03:41:01 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0555e8a7-ac3c-472a-b7ce-0b66d2c3bf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e765d4c-e26e-482f-b09c-d9515174504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:01 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Volume volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 (f67f332c-3d06-45c4-a2e7-af9e0b915e21): created successfully
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e765d4c-e26e-482f-b09c-d9515174504f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:01 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Flow 'volume_create_manager' (c3c5937d-3f02-487c-b334-4c2b39dcd089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:01 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7bc16a36-339c-40df-ac4e-0241b65ed7f4 tempest-SnapshotDependencyTests-1005236387 None] Created volume successfully.
Nov 14 03:41:02 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da" returned: 0 in 0.680s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:02 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:41:02 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a46aa8-a042-4a02-925d-e623ccc5216b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:02 devstack sudo[101276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932
Nov 14 03:41:02 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:02 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd 1073741824" returned: 0 in 0.680s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:02 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd
Nov 14 03:41:02 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:02 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932" returned: 0 in 0.661s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:02 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:02 devstack sudo[101286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da
Nov 14 03:41:02 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:03 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd" returned: 0 in 0.506s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.952s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1641004280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ab5871-2a06-47be-9fd2-c6137fe4141f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:57Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Creating volume 06ab5871-2a06-47be-9fd2-c6137fe4141f {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:03 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52988760-9c15-4691-949d-6b029317258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387517ec-818a-4d63-9e37-3164bb8148cd', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ea03a1-2e28-4601-bad1-21c01ee17f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:03 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume volume-387517ec-818a-4d63-9e37-3164bb8148cd (387517ec-818a-4d63-9e37-3164bb8148cd): created successfully
Nov 14 03:41:03 devstack sudo[101289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f 1073741824
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ea03a1-2e28-4601-bad1-21c01ee17f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:03 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (a8c894d8-7167-41ef-afc0-3c334175d35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:03 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f0782467-41f0-40f6-84b9-4ffe7aa7c44c tempest-CreateVolumesFromSnapshotTest-937662215 None] Created volume successfully.
Nov 14 03:41:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:03 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da" returned: 0 in 0.627s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:03 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:03 devstack sudo[101294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da
Nov 14 03:41:03 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (0e86bdbd-2de0-4dc5-8d9e-b93450ee8c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fe582d-ae67-4d4d-869b-da365cadead1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fe582d-ae67-4d4d-869b-da365cadead1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139123372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef32db15-4520-41fe-94ae-bb819762c808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:03Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507f33c0-f504-40f7-8c43-eac727217345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507f33c0-f504-40f7-8c43-eac727217345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4316a456-94da-45bf-b911-b3f656038057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4316a456-94da-45bf-b911-b3f656038057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef32db15-4520-41fe-94ae-bb819762c808', 'volume_name': 'volume-ef32db15-4520-41fe-94ae-bb819762c808', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e2c12c-bf8b-47c8-9062-7dd3d17f32c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e2c12c-bf8b-47c8-9062-7dd3d17f32c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73e6f22-8a08-40ac-8cab-70c122d0cbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:03 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume ef32db15-4520-41fe-94ae-bb819762c808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef32db15-4520-41fe-94ae-bb819762c808', 'volume_size': 1}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:03 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f 1073741824" returned: 0 in 0.654s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:03 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f
Nov 14 03:41:03 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:03 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932.7bec342d-65f1-451d-918f-810aa0f339da" returned: 0 in 0.500s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-7bec342d-65f1-451d-918f-810aa0f339da" released by "_delete_snapshot" :: held 2.534s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:03 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-fe9a9ed9-a344-4aeb-8638-4b39ec095932" released by "delete_snapshot" :: held 2.546s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Created reservations ['2c8bc913-55d6-4a23-8bf6-c2ef534e266b', '6807028a-f490-49e9-a07d-464f1e6e082d', 'a041b43e-fcb3-4ec7-839f-b7ba173a4298', '706e0cc4-3b93-42bf-a72c-917d0e772d5f'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Delete snapshot completed successfully.
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-67d032ac-98c7-44fb-9ee8-3ab7d1817193 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-7bec342d-65f1-451d-918f-810aa0f339da-delete_snapshot" released by "delete_snapshot" :: held 2.632s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:04 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f" returned: 0 in 0.450s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.856s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1383910393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218b1778-13d2-47b0-ae57-83f59ba01e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:57Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Creating volume 218b1778-13d2-47b0-ae57-83f59ba01e53 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:04 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9939b1de-cb1f-47b9-99c2-88230d8bfbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ab5871-2a06-47be-9fd2-c6137fe4141f', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a8f680-c3c3-4d04-8921-3effb893a9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:04 devstack sudo[101303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53 1073741824
Nov 14 03:41:04 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:04 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume volume-06ab5871-2a06-47be-9fd2-c6137fe4141f (06ab5871-2a06-47be-9fd2-c6137fe4141f): created successfully
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a8f680-c3c3-4d04-8921-3effb893a9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (9d77bbe3-0f8f-489a-b5fc-e0a1c8640b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:04 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9a77b491-af60-477c-a14a-a1cd790505e0 tempest-CreateVolumesFromSnapshotTest-937662215 None] Created volume successfully.
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-fe9a9ed9-a344-4aeb-8638-4b39ec095932-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-fe9a9ed9-a344-4aeb-8638-4b39ec095932-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:04 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-quobyte-fe9a9ed9-a344-4aeb-8638-4b39ec095932" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-fe9a9ed9-a344-4aeb-8638-4b39ec095932" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd1df90-f30f-4517-9076-548ce359acd0]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:04 devstack sudo[101305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932
Nov 14 03:41:04 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:04 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53 1073741824" returned: 0 in 0.570s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:04 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:04 devstack sudo[101310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53
Nov 14 03:41:04 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:05 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932" returned: 0 in 0.580s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:05 devstack sudo[101316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932
Nov 14 03:41:05 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:05 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53" returned: 0 in 0.458s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.709s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754259564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:57Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Creating volume fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:05 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85138001-64db-4b23-9014-f56ce3c68acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218b1778-13d2-47b0-ae57-83f59ba01e53', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce77021-7887-4cc5-92d5-399b754a7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:05 devstack sudo[101318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc 1073741824
Nov 14 03:41:05 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:05 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume volume-218b1778-13d2-47b0-ae57-83f59ba01e53 (218b1778-13d2-47b0-ae57-83f59ba01e53): created successfully
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce77021-7887-4cc5-92d5-399b754a7276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (1a9b10d0-cffc-4c9f-bf8f-98ea737bc7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:05 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-382079e1-d351-4d2f-b409-e71df2965857 tempest-CreateVolumesFromSnapshotTest-937662215 None] Created volume successfully.
Nov 14 03:41:05 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fe9a9ed9-a344-4aeb-8638-4b39ec095932" returned: 0 in 0.486s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-fe9a9ed9-a344-4aeb-8638-4b39ec095932" released by "delete_volume" :: held 1.109s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Created reservations ['96f71326-e43b-43fa-834c-c8bc330cd387', '543be851-71f0-4d61-9d27-b0c7008fa6cb', '3b1b6d5d-2239-4cce-8e7c-8a695b8e98d6', 'b0f7e2eb-e646-44b6-b510-d8b26e14cf24'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:05 devstack sudo[101324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:05 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:05 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc 1073741824" returned: 0 in 0.580s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:05 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:05 devstack sudo[101326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc
Nov 14 03:41:05 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:06 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.483s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Deleted volume successfully.
Nov 14 03:41:06 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc" returned: 0 in 0.433s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.538s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1890963803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cc30b6-b127-4c33-979a-e0b7c8b4991a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d23850fc944fa8b1c6be49323ae484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:40:58Z,use_quota=True,user_id='15d7bd6517db42af9fc696738b5907e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Creating volume e4cc30b6-b127-4c33-979a-e0b7c8b4991a {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:06 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cf2d21-147a-452f-827a-de63f42c52ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:06 devstack sudo[101330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a 1073741824
Nov 14 03:41:06 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a420c258-a876-42c0-ad30-de236885ea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-438c5cfd-78a9-4a1c-8098-0d173f1f7c40 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-fe9a9ed9-a344-4aeb-8638-4b39ec095932-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:06 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc (fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc): created successfully
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a420c258-a876-42c0-ad30-de236885ea34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (a79591de-e0eb-4417-8c17-760756a45964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:06 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-35ffafdd-d17e-49c7-a995-a4d2619150c3 tempest-CreateVolumesFromSnapshotTest-937662215 None] Created volume successfully.
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-de638fd5-0c42-4e5b-93ca-c08156c1a15f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-de638fd5-0c42-4e5b-93ca-c08156c1a15f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:06 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "cinder-quobyte-de638fd5-0c42-4e5b-93ca-c08156c1a15f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-de638fd5-0c42-4e5b-93ca-c08156c1a15f" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[301dfca4-9cee-4f21-b3ad-4aaaa9518eec]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:06 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a 1073741824" returned: 0 in 0.598s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:06 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:06 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f
Nov 14 03:41:06 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:06 devstack sudo[101336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a
Nov 14 03:41:06 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:07 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a" returned: 0 in 0.422s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.995s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:07 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0885f249-86c3-4fc9-8968-d9bffd9fe3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4282c4-ad21-4782-a5ce-c531d35eb9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f" returned: 0 in 0.554s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Creating offline snapshot 6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 of volume f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e794d1-c45d-4414-898a-0c51e67b9222]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:07 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f
Nov 14 03:41:07 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:07 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a (e4cc30b6-b127-4c33-979a-e0b7c8b4991a): created successfully
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4282c4-ad21-4782-a5ce-c531d35eb9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Flow 'volume_create_manager' (70ddff78-313f-45a9-b5c5-5deb89053dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:07 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7f07c922-d804-4e39-a03b-f3c0962f6193 tempest-CreateVolumesFromSnapshotTest-937662215 None] Created volume successfully.
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-e4cc30b6-b127-4c33-979a-e0b7c8b4991a-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-e4cc30b6-b127-4c33-979a-e0b7c8b4991a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:07 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-quobyte-e4cc30b6-b127-4c33-979a-e0b7c8b4991a" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-e4cc30b6-b127-4c33-979a-e0b7c8b4991a" acquired by "delete_volume" :: waited 0.006s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:07 devstack sudo[101344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21
Nov 14 03:41:07 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6125cd-016d-4e1d-ab50-f7e4a44ff4c0]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:07 devstack sudo[101347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a
Nov 14 03:41:07 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:07 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-de638fd5-0c42-4e5b-93ca-c08156c1a15f" returned: 0 in 0.520s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-quobyte-de638fd5-0c42-4e5b-93ca-c08156c1a15f" released by "delete_volume" :: held 1.109s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Created reservations ['ba5ad32b-e206-44af-bfe5-d3d39a6a3b21', '737460f9-7e41-4320-be87-567eb808a02d', '726dfafe-2403-4d99-b5e6-f06d5301b19d', '90d7a396-e384-41f0-91a9-70c95776c0ba'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:07 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:08 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:08 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:08 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21" returned: 0 in 0.607s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:08 devstack sudo[101355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 1G
Nov 14 03:41:08 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:08 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a" returned: 0 in 0.609s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:08 devstack sudo[101360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a
Nov 14 03:41:08 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:08 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.465s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:08 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Deleted volume successfully.
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-e255caee-382e-4a95-9303-6a0e99465729 tempest-VolumeDependencyTests-5250879 None] Lock "cinder-de638fd5-0c42-4e5b-93ca-c08156c1a15f-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:08 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 1G" returned: 0 in 0.525s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:08 devstack sudo[101366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08
Nov 14 03:41:08 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:08 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-e4cc30b6-b127-4c33-979a-e0b7c8b4991a" returned: 0 in 0.495s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-e4cc30b6-b127-4c33-979a-e0b7c8b4991a" released by "delete_volume" :: held 1.127s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Created reservations ['35ed3b86-caf0-4275-b599-59197a48335b', '941ff1ff-3959-4041-a94f-6353b67d2a6a', '295fe9e9-acb2-460d-a75d-108e4233ae59', '11eb8936-515f-4cd6-a1f3-828c128ad819'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:08 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:08 devstack sudo[101369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:08 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:09 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" returned: 0 in 0.502s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:09 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 is being set with open permissions: ugo+rw
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:09 devstack sudo[101374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08
Nov 14 03:41:09 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:09 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.491s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:09 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Deleted volume successfully.
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8d78a968-9fe2-4f46-9ad7-6d02d7c45d4d tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-e4cc30b6-b127-4c33-979a-e0b7c8b4991a-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:09 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" returned: 0 in 0.493s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:09 devstack sudo[101378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.info
Nov 14 03:41:09 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:09 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-quobyte-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfeba0f-b8af-4697-a9e5-89fc5c9066d9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:09 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:09 devstack sudo[101380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc
Nov 14 03:41:09 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:10 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.info" returned: 0 in 0.505s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:10 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.info is being set with open permissions: ugo+rw
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:10 devstack sudo[101383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.info
Nov 14 03:41:10 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:10 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:10 devstack sudo[101388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc
Nov 14 03:41:10 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:10 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.info" returned: 0 in 0.474s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.988s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139123372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef32db15-4520-41fe-94ae-bb819762c808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:03Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Creating volume ef32db15-4520-41fe-94ae-bb819762c808 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:10 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:10 devstack sudo[101391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808 1073741824
Nov 14 03:41:10 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:10 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-166244e8-5c7a-42b9-b11e-9931d85b8f13 tempest-SnapshotDependencyTests-1005236387 None] Create snapshot completed successfully
Nov 14 03:41:10 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc" returned: 0 in 0.467s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc" released by "delete_volume" :: held 1.044s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Created reservations ['c5603643-1d86-49f7-92e7-ea78f33f3bc4', 'c92b60ef-a224-41e7-b414-b8126e76daef', 'd01f744d-5cb1-4bbe-a9a2-c9e77605dc3b', 'cd49c100-0a3c-4a11-b33c-9686e28bcf0d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:10 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:10 devstack sudo[101395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:10 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:11 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808 1073741824" returned: 0 in 0.562s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:11 devstack sudo[101400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808
Nov 14 03:41:11 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:11 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.465s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:11 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Deleted volume successfully.
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f886cd76-c63d-4af5-b8ac-4217fedf28d6 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-fcbd8c6b-0a7e-4d8d-aaf6-bb012aa663cc-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:11 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808" returned: 0 in 0.443s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73e6f22-8a08-40ac-8cab-70c122d0cbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef32db15-4520-41fe-94ae-bb819762c808', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd48584-9749-4a5e-8480-690d0a2d08af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume volume-ef32db15-4520-41fe-94ae-bb819762c808 (ef32db15-4520-41fe-94ae-bb819762c808): created successfully
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd48584-9749-4a5e-8480-690d0a2d08af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (0e86bdbd-2de0-4dc5-8d9e-b93450ee8c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:11 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-9661b648-65cf-4987-a46a-72904948eabf tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created volume successfully.
Nov 14 03:41:11 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Flow 'volume_create_manager' (333a5ce5-a5d3-4358-b6e3-89d219ac0d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b3e50d-ec6d-4564-b0d3-7f2e9061ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-218b1778-13d2-47b0-ae57-83f59ba01e53-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b3e50d-ec6d-4564-b0d3-7f2e9061ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82adcd3c-3232-4a5f-8bf1-1e463b17a642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e801a3934c744a6993a7cc4d9a024d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ecac9a1-a9c5-4132-9dc6-3b3d51215f08,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:12Z,use_quota=True,user_id='dd6722d1c8e64265a00738dea4f47b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e1956d-3965-47eb-bf9d-935d173ffdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e1956d-3965-47eb-bf9d-935d173ffdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc78a8a7-63e0-448e-9d3b-829c6cdc9b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc78a8a7-63e0-448e-9d3b-829c6cdc9b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82adcd3c-3232-4a5f-8bf1-1e463b17a642', 'volume_name': 'volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642', 'volume_size': 1, 'snapshot_id': '6ecac9a1-a9c5-4132-9dc6-3b3d51215f08'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6482091-e706-4bb6-8775-1a65fb45a664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6482091-e706-4bb6-8775-1a65fb45a664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449a7381-be5a-4367-b92c-96fbe833e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:11 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Volume 82adcd3c-3232-4a5f-8bf1-1e463b17a642: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642', 'volume_size': 1, 'snapshot_id': '6ecac9a1-a9c5-4132-9dc6-3b3d51215f08'}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-quobyte-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08-82adcd3c-3232-4a5f-8bf1-1e463b17a642" by "_create_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:11 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-218b1778-13d2-47b0-ae57-83f59ba01e53-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08-82adcd3c-3232-4a5f-8bf1-1e463b17a642" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Creating volume 82adcd3c-3232-4a5f-8bf1-1e463b17a642 from snapshot 6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 {{(pid=80846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-quobyte-82adcd3c-3232-4a5f-8bf1-1e463b17a642" by "_copy_volume_from_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-82adcd3c-3232-4a5f-8bf1-1e463b17a642" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] snapshot: 6ecac9a1-a9c5-4132-9dc6-3b3d51215f08, volume: 82adcd3c-3232-4a5f-8bf1-1e463b17a642,  {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Nov 14 03:41:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-quobyte-218b1778-13d2-47b0-ae57-83f59ba01e53" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-218b1778-13d2-47b0-ae57-83f59ba01e53" acquired by "delete_volume" :: waited 0.033s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[988636dc-d310-4834-8f7f-e262a2402517]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e3d050-4b72-4f1c-bb01-8c435ff313ac]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (4c65ea0f-47d8-41fa-a10d-5eaed95e05de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66e151a-91c2-4b5d-97eb-f982575baaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack sudo[101404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08
Nov 14 03:41:12 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66e151a-91c2-4b5d-97eb-f982575baaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7832208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76717fb6-bdef-4e57-a8f7-9b5fdfd1838a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:12Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d62d9a3-598f-4aa9-8a6a-3d0ac2cd66de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d62d9a3-598f-4aa9-8a6a-3d0ac2cd66de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a79bb46-e9ea-4b2a-bbf9-faa5e4a2cdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a79bb46-e9ea-4b2a-bbf9-faa5e4a2cdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76717fb6-bdef-4e57-a8f7-9b5fdfd1838a', 'volume_name': 'volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fc9043-bbf6-4c03-9917-67df1a3cf213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fc9043-bbf6-4c03-9917-67df1a3cf213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a24d7f-bda3-4f10-8d0a-18ae2179b4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume 76717fb6-bdef-4e57-a8f7-9b5fdfd1838a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a', 'volume_size': 1}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:12 devstack sudo[101405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53
Nov 14 03:41:12 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (c01afaaf-0c0d-469b-84c0-f511969f6394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62de879-40c1-46f7-beb0-0490b552be05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62de879-40c1-46f7-beb0-0490b552be05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588885859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:12Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01417b2-3179-47c0-92d2-957f55edd89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01417b2-3179-47c0-92d2-957f55edd89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e44ec2-3e14-4871-9162-2f6c334ffd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e44ec2-3e14-4871-9162-2f6c334ffd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad', 'volume_name': 'volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b884287c-bb3e-4b8e-b9f9-e01dd59639cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b884287c-bb3e-4b8e-b9f9-e01dd59639cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61cb593-308b-4ac3-9061-90e4a88c20c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad', 'volume_size': 1}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (0fad633a-ed62-49dd-be6b-fc3ec64c9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f828205-fe14-468d-ba2c-4437ee911c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f828205-fe14-468d-ba2c-4437ee911c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546245129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27586ee5-d46b-4a2f-9cdf-3556ef7e6c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:13Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112745dd-aa47-48de-aa4b-f7c1af3e49f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112745dd-aa47-48de-aa4b-f7c1af3e49f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6db382e-9a4a-432a-b4f2-76edb12465f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6db382e-9a4a-432a-b4f2-76edb12465f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27586ee5-d46b-4a2f-9cdf-3556ef7e6c99', 'volume_name': 'volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc808e4-b322-4535-9c6d-20f51d94d4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc808e4-b322-4535-9c6d-20f51d94d4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa7bbbb-5210-47d4-bdde-fd59a33b03a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume 27586ee5-d46b-4a2f-9cdf-3556ef7e6c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99', 'volume_size': 1}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:12 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" returned: 0 in 0.632s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] will copy from snapshot at /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Creating direct copy from snapshot {{(pid=80846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6563d725-a0bd-4fc5-b766-ffdd3cb68e03]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:12 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (34150a81-f1d2-482b-9856-a31775a0dc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cffe733-0a6d-4a31-b8b0-9fcbb6c9033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cffe733-0a6d-4a31-b8b0-9fcbb6c9033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1667412653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d8ecc8-a0c9-452b-80ce-456b8d8d58bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:13Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ba9b00-017b-47aa-aecd-15e486bdff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ba9b00-017b-47aa-aecd-15e486bdff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9273bd86-8673-4496-81a6-bf3ba6957321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9273bd86-8673-4496-81a6-bf3ba6957321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d8ecc8-a0c9-452b-80ce-456b8d8d58bf', 'volume_name': 'volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dc60c1-fb43-4934-a4f2-f0b0bc476a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dc60c1-fb43-4934-a4f2-f0b0bc476a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b785a0ba-f71b-4b75-bdd8-d913e97ead90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:12 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume 12d8ecc8-a0c9-452b-80ce-456b8d8d58bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf', 'volume_size': 1}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53" returned: 0 in 0.743s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:12 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:12 devstack sudo[101414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21
Nov 14 03:41:12 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:12 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53
Nov 14 03:41:12 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:13 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (3b723322-9b7b-4f0b-b3de-612eaf51b5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b0b7c8-34ff-4d34-845d-5f58ab3084af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b0b7c8-34ff-4d34-845d-5f58ab3084af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128982338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f41ca6-8de8-4884-8bd1-942246676440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:13Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386b1a63-a460-4f47-a70f-7534a4bf94ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386b1a63-a460-4f47-a70f-7534a4bf94ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9f29c1-3e86-4b34-b2b4-252720be77e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9f29c1-3e86-4b34-b2b4-252720be77e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f41ca6-8de8-4884-8bd1-942246676440', 'volume_name': 'volume-53f41ca6-8de8-4884-8bd1-942246676440', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9db85c2-8a7f-4606-b262-173fc6db1b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9db85c2-8a7f-4606-b262-173fc6db1b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7a27bd-b871-477e-9952-a8b685f49be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:13 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume 53f41ca6-8de8-4884-8bd1-942246676440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f41ca6-8de8-4884-8bd1-942246676440', 'volume_size': 1}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:13 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-218b1778-13d2-47b0-ae57-83f59ba01e53" returned: 0 in 0.451s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-218b1778-13d2-47b0-ae57-83f59ba01e53" released by "delete_volume" :: held 1.228s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Created reservations ['19f0960f-bb4a-49c1-ae02-e3807f8392be', '6c5f627a-5b80-4303-9f26-fc4c8d561329', '825be137-4f49-4153-83fa-897b70f3862c', '1a95638b-2a52-4eeb-8258-a2c133651d8a'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:13 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21" returned: 0 in 0.661s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.utils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Path /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642 not found in is_blk_device check {{(pid=80846) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:13 devstack sudo[101422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:13 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:13 devstack sudo[101424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642
Nov 14 03:41:13 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:13 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.427s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:13 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Deleted volume successfully.
Nov 14 03:41:13 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-fcda0790-5238-4b57-90f0-cecc064e72de tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-218b1778-13d2-47b0-ae57-83f59ba01e53-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-06ab5871-2a06-47be-9fd2-c6137fe4141f-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-06ab5871-2a06-47be-9fd2-c6137fe4141f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:14 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-quobyte-06ab5871-2a06-47be-9fd2-c6137fe4141f" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:14 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-06ab5871-2a06-47be-9fd2-c6137fe4141f" acquired by "delete_volume" :: waited 0.024s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:14 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c94111-e70a-49e2-83cc-f4b4a9a342db]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:14 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:14 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f
Nov 14 03:41:14 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:15 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f" returned: 0 in 1.215s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:15 devstack sudo[101443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f
Nov 14 03:41:15 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:15 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642" returned: 0 in 2.264s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:15 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[209e9a76-fa3a-4c51-b5da-1c0cc4be7fc1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:15 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:15 devstack sudo[101445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21
Nov 14 03:41:15 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:16 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-06ab5871-2a06-47be-9fd2-c6137fe4141f" returned: 0 in 0.425s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-06ab5871-2a06-47be-9fd2-c6137fe4141f" released by "delete_volume" :: held 1.682s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Created reservations ['69986b19-a07e-46b7-b6b1-05ed1637b7a6', '5fdb3942-837f-4a42-860a-90624bfd1f09', '5c5c08b8-e6be-4abf-84e5-50193604740e', 'f0c30287-91e2-44df-af85-22068bc25786'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:16 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:16 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:16 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21" returned: 0 in 0.706s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.image.image_utils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Image conversion details: src /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642 {{(pid=80846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 14 03:41:16 devstack cinder-volume[80846]: INFO cinder.image.image_utils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Converted 1024.00 MB image at 451.99 MB/s
Nov 14 03:41:16 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642 is being set with open permissions: ugo+rw
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:16 devstack sudo[101453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642
Nov 14 03:41:16 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-387517ec-818a-4d63-9e37-3164bb8148cd-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-387517ec-818a-4d63-9e37-3164bb8148cd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:16 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-quobyte-387517ec-818a-4d63-9e37-3164bb8148cd" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-387517ec-818a-4d63-9e37-3164bb8148cd" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a556b96b-2e8f-4f41-9e93-aa083d27c7c4]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:16 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.504s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Deleted volume successfully.
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-c75616b9-6c35-408c-8981-20675dee3bcf tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-06ab5871-2a06-47be-9fd2-c6137fe4141f-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:16 devstack sudo[101456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd
Nov 14 03:41:16 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:16 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642" returned: 0 in 0.436s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-82adcd3c-3232-4a5f-8bf1-1e463b17a642" released by "_copy_volume_from_snapshot" :: held 4.790s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08-82adcd3c-3232-4a5f-8bf1-1e463b17a642" released by "_create_volume_from_snapshot" :: held 4.811s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.825s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.580s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7832208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76717fb6-bdef-4e57-a8f7-9b5fdfd1838a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:12Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Creating volume 76717fb6-bdef-4e57-a8f7-9b5fdfd1838a {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:16 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:16 devstack sudo[101459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a 1073741824
Nov 14 03:41:16 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449a7381-be5a-4367-b92c-96fbe833e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642', 'volume_size': 1, 'snapshot_id': '6ecac9a1-a9c5-4132-9dc6-3b3d51215f08'}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f17f6a-ab57-48bc-9cb5-f545e158a676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:16 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Volume volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642 (82adcd3c-3232-4a5f-8bf1-1e463b17a642): created successfully
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f17f6a-ab57-48bc-9cb5-f545e158a676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:16 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Flow 'volume_create_manager' (333a5ce5-a5d3-4358-b6e3-89d219ac0d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:16 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b39e9c03-de7c-4a4e-a8d7-aff2a172b4eb tempest-SnapshotDependencyTests-1005236387 None] Created volume successfully.
Nov 14 03:41:17 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:17 devstack sudo[101464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd
Nov 14 03:41:17 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:17 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-quobyte-f67f332c-3d06-45c4-a2e7-af9e0b915e21" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-f67f332c-3d06-45c4-a2e7-af9e0b915e21" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-quobyte-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Deleting offline snapshot 6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 of volume f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] snapshot_file for this snap is: volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd200fa-c1cd-4528-b825-d71db371c0bd]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:17 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a 1073741824" returned: 0 in 0.600s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:17 devstack sudo[101470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a
Nov 14 03:41:17 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:17 devstack sudo[101469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08
Nov 14 03:41:17 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:17 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-387517ec-818a-4d63-9e37-3164bb8148cd" returned: 0 in 0.463s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-387517ec-818a-4d63-9e37-3164bb8148cd" released by "delete_volume" :: held 1.048s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Created reservations ['4044fae9-afcb-4eef-a0e5-609c4d0c7725', '3d68b53e-7935-4847-a37a-f4b772dca434', '680cf633-ec70-4eca-879d-274b24006afa', '0d12c6ae-44bc-45a5-acf0-fb13810e2a02'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:17 devstack sudo[101474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:17 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:17 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a" returned: 0 in 0.481s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.504s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588885859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:12Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Creating volume f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:17 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a24d7f-bda3-4f10-8d0a-18ae2179b4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:17 devstack sudo[101479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad 1073741824
Nov 14 03:41:17 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b00c6a-4fec-47ba-bf74-6ec0dc3ab9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:17 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a (76717fb6-bdef-4e57-a8f7-9b5fdfd1838a): created successfully
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b00c6a-4fec-47ba-bf74-6ec0dc3ab9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:17 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (4c65ea0f-47d8-41fa-a10d-5eaed95e05de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:17 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-e6e61990-a107-4ac4-8e59-2073d0e11a66 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created volume successfully.
Nov 14 03:41:18 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" returned: 0 in 0.698s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb2af8b-896d-4620-9a99-761694c6130b]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:18 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.469s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:18 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Deleted volume successfully.
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-778bd8c6-649f-4076-bab2-32366c402ee7 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-387517ec-818a-4d63-9e37-3164bb8148cd-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:18 devstack sudo[101483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21
Nov 14 03:41:18 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:18 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad 1073741824" returned: 0 in 0.598s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:18 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad
Nov 14 03:41:18 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:18 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21" returned: 0 in 0.586s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:18 devstack sudo[101494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08
Nov 14 03:41:18 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-b5d455a1-9b17-4c6a-8610-38ea7fbdd30b-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-b5d455a1-9b17-4c6a-8610-38ea7fbdd30b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:18 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-quobyte-cd795498-9586-4cd7-b3fd-521f5d81e0b9" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-cd795498-9586-4cd7-b3fd-521f5d81e0b9" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-quobyte-b5d455a1-9b17-4c6a-8610-38ea7fbdd30b" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-b5d455a1-9b17-4c6a-8610-38ea7fbdd30b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Deleting offline snapshot b5d455a1-9b17-4c6a-8610-38ea7fbdd30b of volume cd795498-9586-4cd7-b3fd-521f5d81e0b9 {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] snapshot_file for this snap is: volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d2c04a-3bd1-4973-a50e-48355f6ea21d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:18 devstack sudo[101496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b
Nov 14 03:41:18 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:18 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad" returned: 0 in 0.460s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.370s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546245129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27586ee5-d46b-4a2f-9cdf-3556ef7e6c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:13Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:18 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Creating volume 27586ee5-d46b-4a2f-9cdf-3556ef7e6c99 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:19 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:19 devstack sudo[101499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99 1073741824
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61cb593-308b-4ac3-9061-90e4a88c20c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:19 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786168a9-49ed-4799-9feb-d94602caac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:19 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad (f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad): created successfully
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786168a9-49ed-4799-9feb-d94602caac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (c01afaaf-0c0d-469b-84c0-f511969f6394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-63ec9458-0e0d-48fa-baa8-7e6d20436975 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created volume successfully.
Nov 14 03:41:19 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" returned: 0 in 0.523s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:19 devstack sudo[101504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08
Nov 14 03:41:19 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:19 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b" returned: 0 in 0.611s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4411e53f-9037-424d-ac08-b21a83cc5b1e]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:19 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9
Nov 14 03:41:19 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:19 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99 1073741824" returned: 0 in 0.607s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:19 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99
Nov 14 03:41:19 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:19 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21.6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" returned: 0 in 0.511s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08" released by "_delete_snapshot" :: held 2.381s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-f67f332c-3d06-45c4-a2e7-af9e0b915e21" released by "delete_snapshot" :: held 2.396s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Created reservations ['0c456115-94ff-436d-acb9-ed1a94b59525', '84f50dd7-1b82-48dc-b5cc-afcf6936d8fe', '6f985259-1e53-4001-9c50-ea8eba96c352', '001b7b28-145f-4793-9f68-a42cfd4c4135'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:19 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Delete snapshot completed successfully.
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-52fc0244-9246-4d51-9a41-e6baeee05e4d tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-6ecac9a1-a9c5-4132-9dc6-3b3d51215f08-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:19 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9" returned: 0 in 0.606s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:19 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:20 devstack sudo[101520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b
Nov 14 03:41:20 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:20 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99" returned: 0 in 0.486s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.269s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1667412653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d8ecc8-a0c9-452b-80ce-456b8d8d58bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:13Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Creating volume 12d8ecc8-a0c9-452b-80ce-456b8d8d58bf {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:20 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:20 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf 1073741824
Nov 14 03:41:20 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa7bbbb-5210-47d4-bdde-fd59a33b03a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e3b345-22da-41cd-bd94-4eef48337324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:20 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99 (27586ee5-d46b-4a2f-9cdf-3556ef7e6c99): created successfully
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e3b345-22da-41cd-bd94-4eef48337324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (0fad633a-ed62-49dd-be6b-fc3ec64c9e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:20 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-4766802b-f91f-4115-8289-56c3fe153691 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created volume successfully.
Nov 14 03:41:20 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b" returned: 0 in 0.484s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:20 devstack sudo[101528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b
Nov 14 03:41:20 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-f67f332c-3d06-45c4-a2e7-af9e0b915e21-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-f67f332c-3d06-45c4-a2e7-af9e0b915e21-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:20 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-quobyte-f67f332c-3d06-45c4-a2e7-af9e0b915e21" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-f67f332c-3d06-45c4-a2e7-af9e0b915e21" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d89a14-0cd9-4e23-9efb-125b790213b2]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:20 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf 1073741824" returned: 0 in 0.626s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:20 devstack sudo[101533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21
Nov 14 03:41:20 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:20 devstack sudo[101534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf
Nov 14 03:41:20 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:20 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:20 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9.b5d455a1-9b17-4c6a-8610-38ea7fbdd30b" returned: 0 in 0.498s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-b5d455a1-9b17-4c6a-8610-38ea7fbdd30b" released by "_delete_snapshot" :: held 2.262s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-cd795498-9586-4cd7-b3fd-521f5d81e0b9" released by "delete_snapshot" :: held 2.274s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Created reservations ['eb5f4566-a619-4635-8920-8bf32bf66d89', 'b943ffd0-35ab-4955-8cea-54f486371cd9', 'e8ee9a64-e5e4-4697-a8b3-e0fb2d359bc9', 'fece4ce9-0a09-489b-bbc0-13c05b9bfc8c'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:21 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Delete snapshot completed successfully.
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59a6d4d5-53ac-4b5e-bad9-16ba722dfb76 tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-b5d455a1-9b17-4c6a-8610-38ea7fbdd30b-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:21 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf" returned: 0 in 0.447s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.126s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128982338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f41ca6-8de8-4884-8bd1-942246676440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3744fd7b37a446f2b143b94ddb9a25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:13Z,use_quota=True,user_id='a4a49ce3556c46d4825222cef0d5f29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Creating volume 53f41ca6-8de8-4884-8bd1-942246676440 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:21 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:21 devstack sudo[101543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440 1073741824
Nov 14 03:41:21 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b785a0ba-f71b-4b75-bdd8-d913e97ead90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37059e16-57b1-4063-aceb-002571263485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:21 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf (12d8ecc8-a0c9-452b-80ce-456b8d8d58bf): created successfully
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37059e16-57b1-4063-aceb-002571263485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:21 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (34150a81-f1d2-482b-9856-a31775a0dc96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21" returned: 0 in 0.597s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:21 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-713dec46-423d-4d0b-b4c9-e7b65beb2dc7 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created volume successfully.
Nov 14 03:41:21 devstack sudo[101545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21
Nov 14 03:41:21 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:21 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f67f332c-3d06-45c4-a2e7-af9e0b915e21" returned: 0 in 0.470s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-f67f332c-3d06-45c4-a2e7-af9e0b915e21" released by "delete_volume" :: held 1.098s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:21 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440 1073741824" returned: 0 in 0.558s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:21 devstack sudo[101551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440
Nov 14 03:41:21 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Created reservations ['e3ac61e8-148f-4068-8a45-4c6ed61911a3', '4f19f837-cfb8-4cee-b185-47dc44315d6f', 'c04169d8-abdf-4d91-8c4e-bd4f0f7e0af5', '8bddcfae-0db2-4fa8-938f-0780a54df29f'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-cd795498-9586-4cd7-b3fd-521f5d81e0b9-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-cd795498-9586-4cd7-b3fd-521f5d81e0b9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:21 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:21 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:21 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "cinder-quobyte-cd795498-9586-4cd7-b3fd-521f5d81e0b9" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-cd795498-9586-4cd7-b3fd-521f5d81e0b9" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba58dfc-3736-4474-a49e-89d8c2cd0ed6]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:21 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:22 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9
Nov 14 03:41:22 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:22 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440" returned: 0 in 0.451s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7a27bd-b871-477e-9952-a8b685f49be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f41ca6-8de8-4884-8bd1-942246676440', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff39d05-7a84-4a0a-8655-f5c380640c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:22 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume volume-53f41ca6-8de8-4884-8bd1-942246676440 (53f41ca6-8de8-4884-8bd1-942246676440): created successfully
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff39d05-7a84-4a0a-8655-f5c380640c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Flow 'volume_create_manager' (3b723322-9b7b-4f0b-b3de-612eaf51b5d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:22 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2bb38ff6-30a7-4758-bcf7-feca9473336c tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created volume successfully.
Nov 14 03:41:22 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.477s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:22 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Deleted volume successfully.
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-64426fb6-2082-4bbc-93b2-2338fcb92b19 tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-f67f332c-3d06-45c4-a2e7-af9e0b915e21-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:22 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:22 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9
Nov 14 03:41:22 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-82adcd3c-3232-4a5f-8bf1-1e463b17a642-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-82adcd3c-3232-4a5f-8bf1-1e463b17a642-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:22 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "cinder-quobyte-82adcd3c-3232-4a5f-8bf1-1e463b17a642" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-82adcd3c-3232-4a5f-8bf1-1e463b17a642" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c05ec0a-309b-4fa8-9cfb-8fe67fff454f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-53f41ca6-8de8-4884-8bd1-942246676440-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-53f41ca6-8de8-4884-8bd1-942246676440-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:22 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-quobyte-53f41ca6-8de8-4884-8bd1-942246676440" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-53f41ca6-8de8-4884-8bd1-942246676440" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1472ca-707b-4f6e-ba13-8194a4dc886c]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:22 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642
Nov 14 03:41:22 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:22 devstack sudo[101565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440
Nov 14 03:41:22 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:22 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:22 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-cd795498-9586-4cd7-b3fd-521f5d81e0b9" returned: 0 in 0.513s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-quobyte-cd795498-9586-4cd7-b3fd-521f5d81e0b9" released by "delete_volume" :: held 1.104s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Created reservations ['352d0d75-9811-4e91-92d1-a26611c7b517', 'a05d38a9-c48e-4420-bf2e-1b5e6f4bd89d', '91823b2b-98e5-4f99-8158-f789f4494b99', 'bf552839-6526-4d2c-b4a3-cc92efe05a3b'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:23 devstack sudo[101569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:23 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:23 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642" returned: 0 in 0.587s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:23 devstack sudo[101577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642
Nov 14 03:41:23 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:23 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440" returned: 0 in 0.562s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:23 devstack sudo[101579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440
Nov 14 03:41:23 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:23 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.458s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:23 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Deleted volume successfully.
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-ec82f9b4-3011-4eba-8977-9654d707f99c tempest-CreateVolumesFromSnapshotTest-937662215 None] Lock "cinder-cd795498-9586-4cd7-b3fd-521f5d81e0b9-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:23 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-82adcd3c-3232-4a5f-8bf1-1e463b17a642" returned: 0 in 0.444s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-quobyte-82adcd3c-3232-4a5f-8bf1-1e463b17a642" released by "delete_volume" :: held 1.058s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Created reservations ['6ab09dbd-25d9-44aa-8c80-9b4ba5edb3d3', '9829214c-48e9-4d84-9228-a81b1744b460', '62998191-baf5-4b43-9858-5f0e79f894d9', 'db8de3aa-85e6-403a-b36d-9ffce22a1512'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:23 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-53f41ca6-8de8-4884-8bd1-942246676440" returned: 0 in 0.498s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-53f41ca6-8de8-4884-8bd1-942246676440" released by "delete_volume" :: held 1.086s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:23 devstack sudo[101584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:23 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:23 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created reservations ['f41e42fb-cf4d-46a3-bb12-67c114fbb731', 'c215f549-773c-42b0-8f66-84be31c8ca37', 'da0e4218-c469-4c13-9ee0-07d1cbf61355', '3dc99e83-c956-44f9-b6d5-94d2bd957d0d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:24 devstack sudo[101586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:24 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:24 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.538s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:24 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Deleted volume successfully.
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-0564cace-6130-4e33-93d8-3baed4c95d63 tempest-SnapshotDependencyTests-1005236387 None] Lock "cinder-82adcd3c-3232-4a5f-8bf1-1e463b17a642-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:24 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.465s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:24 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Deleted volume successfully.
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-f82fc560-51aa-4c66-8849-942551beac7a tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-53f41ca6-8de8-4884-8bd1-942246676440-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:24 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-quobyte-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf" acquired by "delete_volume" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d5432e-9c36-46e1-bbdf-b00f0ae03a65]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:25 devstack sudo[101622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf
Nov 14 03:41:25 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:25 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf" returned: 0 in 0.665s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:25 devstack sudo[101635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf
Nov 14 03:41:25 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:25 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Flow 'volume_create_manager' (70a0ea9e-e3f8-41fa-b62b-83426c815395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f6a1a4-2ec2-4f0c-ba06-24ce8b81dccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f6a1a4-2ec2-4f0c-ba06-24ce8b81dccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c7d238-30b4-43d2-8cd2-de3b063f7699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6afc67507054d86a57a7b2a720652b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:26Z,use_quota=True,user_id='ffd8484fec224b7295c77bfb6a30380e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:25 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b9543a-3db8-427f-acc5-23e144079602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b9543a-3db8-427f-acc5-23e144079602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22bd9d9-88ab-46bd-80b0-6486b22d621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22bd9d9-88ab-46bd-80b0-6486b22d621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c7d238-30b4-43d2-8cd2-de3b063f7699', 'volume_name': 'volume-87c7d238-30b4-43d2-8cd2-de3b063f7699', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97de12c-2aa2-4fa7-a9ee-59832c58a671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97de12c-2aa2-4fa7-a9ee-59832c58a671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c7cc77-3d44-4076-853e-226d7095dec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:26 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Volume 87c7d238-30b4-43d2-8cd2-de3b063f7699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c7d238-30b4-43d2-8cd2-de3b063f7699', 'volume_size': 1}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c7d238-30b4-43d2-8cd2-de3b063f7699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6afc67507054d86a57a7b2a720652b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:26Z,use_quota=True,user_id='ffd8484fec224b7295c77bfb6a30380e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Creating volume 87c7d238-30b4-43d2-8cd2-de3b063f7699 {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:26 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:26 devstack sudo[101638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699 1073741824
Nov 14 03:41:26 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:26 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf" returned: 0 in 0.549s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf" released by "delete_volume" :: held 1.254s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created reservations ['1e66915a-8db0-451d-a90f-d0d04b696e62', '35e8710a-7237-4d00-8fba-1f13da98d4da', '4b47d107-1b10-4d42-b203-b8b8646b0da3', 'f179159a-2761-4649-94d6-7356913c5336'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:26 devstack sudo[101641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:26 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:26 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699 1073741824" returned: 0 in 0.668s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:26 devstack sudo[101646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699
Nov 14 03:41:26 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:26 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.484s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:26 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Deleted volume successfully.
Nov 14 03:41:26 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-af5142ad-5b85-49c5-a7ef-24e03606b0e4 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-12d8ecc8-a0c9-452b-80ce-456b8d8d58bf-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:27 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:27 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-quobyte-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699" returned: 0 in 0.530s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99" acquired by "delete_volume" :: waited 0.013s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c7cc77-3d44-4076-853e-226d7095dec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c7d238-30b4-43d2-8cd2-de3b063f7699', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5063c9-0d56-42c2-8ea5-0c3bddf8fe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaadd5a-768a-4a6b-a1b3-e9959ce515e1]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:27 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Volume volume-87c7d238-30b4-43d2-8cd2-de3b063f7699 (87c7d238-30b4-43d2-8cd2-de3b063f7699): created successfully
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5063c9-0d56-42c2-8ea5-0c3bddf8fe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Flow 'volume_create_manager' (70a0ea9e-e3f8-41fa-b62b-83426c815395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:27 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-327087f1-80e3-42b4-aa34-8430d6730d56 tempest-CinderUnicodeTest-802229645 None] Created volume successfully.
Nov 14 03:41:27 devstack sudo[101650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99
Nov 14 03:41:27 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:27 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99" returned: 0 in 0.640s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:27 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:27 devstack sudo[101656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99
Nov 14 03:41:27 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:28 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Flow 'volume_create_manager' (d2011c19-4e97-411c-8e53-89c15646d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842954a5-3f78-43a8-b65f-1f1a43b940e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842954a5-3f78-43a8-b65f-1f1a43b940e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1554761317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b2eccc-11cc-40f8-b9e4-5eb3c85daddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6afc67507054d86a57a7b2a720652b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:28Z,use_quota=True,user_id='ffd8484fec224b7295c77bfb6a30380e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c54a713-7d74-47c7-b8fc-17e4a21a08d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c54a713-7d74-47c7-b8fc-17e4a21a08d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64c39f7-9817-4cd1-a0a3-91c34da9d1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64c39f7-9817-4cd1-a0a3-91c34da9d1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b2eccc-11cc-40f8-b9e4-5eb3c85daddc', 'volume_name': 'volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d44d84f-4899-46b9-b292-a42632341abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d44d84f-4899-46b9-b292-a42632341abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfdfc19-0d7a-4523-ab32-0cba9237fa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:28 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Volume 28b2eccc-11cc-40f8-b9e4-5eb3c85daddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc', 'volume_size': 1}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fed278d92d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-14T02:41:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1554761317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b2eccc-11cc-40f8-b9e4-5eb3c85daddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6afc67507054d86a57a7b2a720652b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-14T02:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-14T02:41:28Z,use_quota=True,user_id='ffd8484fec224b7295c77bfb6a30380e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db599239-0960-4d11-94f0-325a0f2f39b0),volume_type_id=db599239-0960-4d11-94f0-325a0f2f39b0)}" {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Creating volume 28b2eccc-11cc-40f8-b9e4-5eb3c85daddc {{(pid=80846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Selected osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead as target Quobyte volume. {{(pid=80846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Nov 14 03:41:28 devstack cinder-volume[80846]: INFO cinder.volume.drivers.remotefs [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] casted to osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc 1073741824 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:28 devstack sudo[101659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc 1073741824
Nov 14 03:41:28 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:28 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99" returned: 0 in 0.561s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99" released by "delete_volume" :: held 1.250s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created reservations ['a7bf71ff-fe40-463c-9cbd-8aec3a742bb4', '02cdb1a6-a804-473b-b2f0-f4d16f57d8f5', 'b20e0197-a669-46bd-b035-17c0b5c5b5e4', '97388697-b107-4cb2-8e3b-400f3ca50db3'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:28 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:28 devstack sudo[101662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:28 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:29 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc 1073741824" returned: 0 in 0.600s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:29 devstack sudo[101668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc
Nov 14 03:41:29 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:29 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.493s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Deleted volume successfully.
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-b0d4daef-0f6f-46dc-a449-cd8604f55265 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-27586ee5-d46b-4a2f-9cdf-3556ef7e6c99-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:29 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-quobyte-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad" acquired by "delete_volume" :: waited 0.049s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe455d2-ccee-43c4-a8ab-ae118a35cb5d]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:29 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" returned: 0 in 0.537s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'} {{(pid=80846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfdfc19-0d7a-4523-ab32-0cba9237fa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc', 'volume_size': 1}' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d38bca8-0b8c-4bb4-b13c-aab6788401c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 14 03:41:29 devstack cinder-volume[80846]: INFO cinder.volume.flows.manager.create_volume [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Volume volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc (28b2eccc-11cc-40f8-b9e4-5eb3c85daddc): created successfully
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d38bca8-0b8c-4bb4-b13c-aab6788401c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80846) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 14 03:41:29 devstack cinder-volume[80846]: DEBUG cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Flow 'volume_create_manager' (d2011c19-4e97-411c-8e53-89c15646d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80846) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 14 03:41:29 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-7493fa6a-66d9-4d2a-94fd-18922d478cb5 tempest-CinderUnicodeTest-802229645 None] Created volume successfully.
Nov 14 03:41:29 devstack sudo[101671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad
Nov 14 03:41:29 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:30 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad" returned: 0 in 0.622s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:30 devstack sudo[101677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad
Nov 14 03:41:30 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:30 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad" returned: 0 in 0.493s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad" released by "delete_volume" :: held 1.146s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created reservations ['7598c319-7f75-4c9e-8f98-5b311ecb5a5f', '16b0ee69-9591-4666-bb95-8688642e035a', '0db966ac-b97e-4a4d-b028-8de6927a7cae', '0041f319-78c8-4484-982f-ef572fedff90'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:30 devstack sudo[101680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:30 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:30 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Creating offline snapshot c73a2d79-7a48-40c0-91ce-5790e9b69aee of volume 28b2eccc-11cc-40f8-b9e4-5eb3c85daddc {{(pid=80846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3682a-c7f1-4296-95d2-c3457b0b3503]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:30 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:30 devstack sudo[101683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc
Nov 14 03:41:30 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:31 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.498s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:31 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Deleted volume successfully.
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-cca0129f-b0d3-40cf-b7b9-bd36c22eddc8 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-f0e41b2c-6eb1-4bb7-8ce2-f57f8a1c6aad-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:31 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" returned: 0 in 0.671s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee 1G {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:31 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee 1G
Nov 14 03:41:31 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:31 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-quobyte-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a" acquired by "delete_volume" :: waited 0.020s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5870a870-cda9-430e-8faf-570848f60e5f]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:31 devstack sudo[101691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a
Nov 14 03:41:31 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:31 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee 1G" returned: 0 in 0.501s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:31 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:31 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee
Nov 14 03:41:31 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:32 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a" returned: 0 in 0.587s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:32 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a
Nov 14 03:41:32 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:32 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc -F qcow2 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee" returned: 0 in 0.454s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:32 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee is being set with open permissions: ugo+rw
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:32 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee
Nov 14 03:41:32 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:32 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a" returned: 0 in 0.465s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a" released by "delete_volume" :: held 1.076s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created reservations ['5bd11e9d-a056-4e59-88c2-91cc935bf0e3', 'baf0c4a9-9ec1-4c29-a5a2-7e24e1f7a383', 'f3ddb840-b940-45ff-97e0-ecbc151df099', 'c4bd09ca-5509-4ebc-a35a-cede05ef9d2b'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:32 devstack sudo[101709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:32 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:32 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee" returned: 0 in 0.448s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:32 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:32 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.info
Nov 14 03:41:32 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:33 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.424s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Deleted volume successfully.
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-2a505c13-3c3e-42ac-a246-59e860293db3 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-76717fb6-bdef-4e57-a8f7-9b5fdfd1838a-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:33 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.info" returned: 0 in 0.454s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:33 devstack cinder-volume[80846]: WARNING cinder.volume.drivers.remotefs [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.info is being set with open permissions: ugo+rw
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.info {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:33 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.info
Nov 14 03:41:33 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-ef32db15-4520-41fe-94ae-bb819762c808-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-ef32db15-4520-41fe-94ae-bb819762c808-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:33 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.info" returned: 0 in 0.439s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "cinder-quobyte-ef32db15-4520-41fe-94ae-bb819762c808" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:33 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-82eac86c-46c8-4372-a947-4f3b6016f83a tempest-CinderUnicodeTest-802229645 None] Create snapshot completed successfully
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-ef32db15-4520-41fe-94ae-bb819762c808" acquired by "delete_volume" :: waited 0.016s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5832b43e-b62b-4bb1-9fcf-ae085b28c1a9]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "cinder-c73a2d79-7a48-40c0-91ce-5790e9b69aee-delete_snapshot" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-c73a2d79-7a48-40c0-91ce-5790e9b69aee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:33 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "cinder-quobyte-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" by "delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-quobyte-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "cinder-quobyte-c73a2d79-7a48-40c0-91ce-5790e9b69aee" by "_delete_snapshot" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-quobyte-c73a2d79-7a48-40c0-91ce-5790e9b69aee" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Deleting offline snapshot c73a2d79-7a48-40c0-91ce-5790e9b69aee of volume 28b2eccc-11cc-40f8-b9e4-5eb3c85daddc {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 14 03:41:33 devstack sudo[101719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808
Nov 14 03:41:33 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] snapshot_file for this snap is: volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee {{(pid=80846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[249b018b-64c3-4246-a4a8-bf9558b958fe]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:33 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:34 devstack sudo[101721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee
Nov 14 03:41:34 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:34 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:34 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808
Nov 14 03:41:34 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:34 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee" returned: 0 in 0.549s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.remotefs [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b4bf2d-46f3-4442-91fc-ae48895401bc]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:34 devstack sudo[101731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc
Nov 14 03:41:34 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:34 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-ef32db15-4520-41fe-94ae-bb819762c808" returned: 0 in 0.442s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-quobyte-ef32db15-4520-41fe-94ae-bb819762c808" released by "delete_volume" :: held 1.021s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Created reservations ['686b18b6-b1f2-48d9-a475-1127662b1ad3', 'fb4f72dc-3679-40e9-a173-2330a06ba847', '49e2d7a0-07a9-4f63-b5d9-107bd4ce5b46', 'b03b00a7-d9ac-4761-8228-03b9a08259c7'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:34 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:34 devstack sudo[101734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:34 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:35 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" returned: 0 in 0.556s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:35 devstack sudo[101739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee
Nov 14 03:41:35 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:35 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.466s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:35 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:35 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Deleted volume successfully.
Nov 14 03:41:35 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-969e3e8b-36f3-4576-8238-7254732e4df0 tempest-CreateVolumesFromSourceVolumeTest-1217014569 None] Lock "cinder-ef32db15-4520-41fe-94ae-bb819762c808-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:35 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee" returned: 0 in 0.489s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:35 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:35 devstack sudo[101745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee
Nov 14 03:41:35 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:36 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:36 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc.c73a2d79-7a48-40c0-91ce-5790e9b69aee" returned: 0 in 0.462s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-quobyte-c73a2d79-7a48-40c0-91ce-5790e9b69aee" released by "_delete_snapshot" :: held 2.119s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-quobyte-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" released by "delete_snapshot" :: held 2.132s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:36 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Created reservations ['008ace94-2145-42fe-819f-b252e2d5439c', '92d19a56-4f6d-4b94-b3a7-6845b41afb6c', '61ec143f-cb8c-4b94-bf72-85b5214ae700', '299ff92b-ab8d-41be-a1a5-99500931db42'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:36 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Delete snapshot completed successfully.
Nov 14 03:41:36 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-8894a065-441a-41b4-bd69-a2a154d55ac9 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-c73a2d79-7a48-40c0-91ce-5790e9b69aee-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Acquiring lock "cinder-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Lock "cinder-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:37 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Acquiring lock "cinder-quobyte-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:37 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Lock "cinder-quobyte-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" acquired by "delete_volume" :: waited 0.011s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:37 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd556beb-be21-478a-ac94-bc0cef1b40c3]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:37 devstack sudo[101748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc
Nov 14 03:41:37 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:37 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" returned: 0 in 0.554s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:37 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:37 devstack sudo[101753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc
Nov 14 03:41:37 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:38 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" returned: 0 in 0.464s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Lock "cinder-quobyte-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc" released by "delete_volume" :: held 1.057s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=153,cinder:UPDATE=278,cinder:DELETE=24,cinder:INSERT=53 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:UPDATE=203,cinder:SELECT=161,cinder:DELETE=24,cinder:INSERT=47 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Created reservations ['b3748a14-8d08-4153-8075-e35a495c9d5a', '3399b16c-02c8-436e-aaed-dc9ee3f247b5', 'a18f1ba2-ea80-4e2f-970b-5a3aea76338f', 'f300004a-2188-4e71-b3c3-74709488427d'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:38 devstack sudo[101756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:38 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:38 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.440s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:38 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Deleted volume successfully.
Nov 14 03:41:38 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-d0908d37-417a-4622-bcb0-5fd9c0d1beaa tempest-CinderUnicodeTest-802229645 None] Lock "cinder-28b2eccc-11cc-40f8-b9e4-5eb3c85daddc-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "cinder-87c7d238-30b4-43d2-8cd2-de3b063f7699-delete_volume" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-87c7d238-30b4-43d2-8cd2-de3b063f7699-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:39 devstack cinder-volume[80846]: WARNING cinder.volume.volume_utils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Nov 14 03:41:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "cinder-quobyte-87c7d238-30b4-43d2-8cd2-de3b063f7699" by "delete_volume" {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 14 03:41:39 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-quobyte-87c7d238-30b4-43d2-8cd2-de3b063f7699" acquired by "delete_volume" :: waited 0.007s {{(pid=80846) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 14 03:41:39 devstack cinder-volume[80846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c27e696-f8bd-4dc5-b146-bdf0a4d3c092]: (4, 'qcow2') {{(pid=82078) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 14 03:41:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:39 devstack sudo[101759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699
Nov 14 03:41:39 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:39 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699" returned: 0 in 0.544s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:39 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:39 devstack sudo[101764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699
Nov 14 03:41:39 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:40 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1/volume-87c7d238-30b4-43d2-8cd2-de3b063f7699" returned: 0 in 0.441s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-quobyte-87c7d238-30b4-43d2-8cd2-de3b063f7699" released by "delete_volume" :: held 1.008s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG cinder.quota [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Created reservations ['9f157d62-472f-4f44-909d-0e9e03b684e7', 'd91e816d-c0fe-4396-85ee-158800b95f1d', '10c86719-20fd-403e-a6ec-4230cc7fe616', 'e72d71f0-8cb4-4d8a-adcd-143e179963db'] {{(pid=80846) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead': None} {{(pid=80846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG cinder.volume.drivers.quobyte [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30d219e7-38cc-4366-86ce-de58e2ffdead'] {{(pid=80846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.lockutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80846) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1 {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 14 03:41:40 devstack sudo[101767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1
Nov 14 03:41:40 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 14 03:41:40 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG oslo_concurrency.processutils [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/34a9f946af15bc01f220ee727c1dadc1" returned: 0 in 0.460s {{(pid=80846) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG cinder.manager [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Notifying Schedulers of capabilities ... {{(pid=80846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 14 03:41:40 devstack cinder-volume[80846]: INFO cinder.volume.manager [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Deleted volume successfully.
Nov 14 03:41:40 devstack cinder-volume[80846]: DEBUG cinder.coordination [None req-59d5e27d-1a4f-4c12-a12e-894fbe261cb4 tempest-CinderUnicodeTest-802229645 None] Lock "cinder-87c7d238-30b4-43d2-8cd2-de3b063f7699-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=80846) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 14 03:41:50 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 14 03:41:50 devstack cinder-volume[80846]: DEBUG dbcounter [-] [80846] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=80846) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}